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The Journal of Consulting Psychology will 
accept Brief Reports of research studies in 
clinical psychology for early publication with- 
out expense to the author. The procedure is 
intended to permit the publication of soundly 
designed studies of specialized interest or lim- 
ited importance which cannot now be ac- 
cepted because of lack of space. Several pages 
in each issue will be devoted to Brief Reports, 
published in the order of their receipt with- 
out respect to the dates of receipt of the regu- 
lar articles. Most Brief Reports appear in the 
first or second issue to go to press following 
their final acceptance. 

An author who wishes to submit a Brief 
Report: 

1. Sends the Brief Report, limited to one printed 
page and prepared according to the specifications 


given below. 


+ 


2. Also sends to the Editor a full report of the re- 
search study, in sufficient detail to give a clear ac- 
count of its background, procedure, results, and con- 
clusions, which will be filed with the American 
Documentation Institute to insure indefinite avail- 
ability. 

3. Prepares at least 100 mimeographed copies of 
the full report, which the author will send without 
charge to all who request it as long as the supply 
lasts. 

4. Agrees not to submit the full report to another 
journal of general circulation. 


Specifications 


Brief Report. The Brief Report should give 
a clear, condensed summary of the procedure 
of the study and as full an account of the re- 
sults as space permits. 


Brief Reports 


To insure that the Brief Report will be no 
longer than one printed page, its typescript, 
including all matter except the title and the 
author’s lines, must not exceed 70 lines av- 
eraging 42 characters and spaces in length. 
Set the typewriter margins for short lines of 
42 characters, which are 3.5 inches long in 
elite typing, and 4.2 inches long in pica. 

The manuscript of the Brief Report must 
be double spaced throughout. Except for its 
short lines, it follows the standard style (1). 
Headings, tables, and references are avoided 
or, if essential, must be counted in the 70 
lines. Each Brief Report must be accom- 
panied by a footnote in the style below, 
which is typed on a separate sheet and not 
counted in the 70-line quota: * 


1 An extended report of this study may be ob- 
tained without charge from John Doe, 300 Market 
St., Prospect 6, Mass. (giving the author’s full name 
and address), or for a fee from the American Docu- 
mentation Institute. Order Document No. from 
ADI Auxiliary Publications Project, Photoduplica- 
tion Service, Library of Congress, Washington 25, 
D. C., remitting in advance $—— for microfilm or 
$ for photocopies. Make checks payable to Chief, 
Photoduplication Service, Library of Congress. 








Extended report. The full report is pre- 
pared in the style specified by the Publica- 
tion Manual (1), except that it may be typed 
with single spacing for economy in photo- 
duplication by the ADI. 
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Editors. Publication manual of the American 
Psychological Association. Psychol. Bull., 1952, 
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Changes in Psychoneurotic Patients 
With and Without Psychotherapy’ 


Frank Barron 


Institute of Personality Assessment and Research, University of California, Berkeley 


and Timothy F. Leary 


Kaiser Foundation Hospital, Oakland, California 


Two tendencies seem constantly at work in 
living systems: the tendency to integrate a 
durable and stable arrangement of internal 
parts and external relationships, and the in- 
teracting opposite of this, the tendency to re- 
spond variably either to pressures arising 
from internal structure or to new external 
conditions in such a way as to break down 
old forms of organization and replace them 
with new ones. 

In psychoneurosis, which is in part at least 
an attempt to stabilize matters internally and 
externally, one might expect also that forces 
arising internally and tending towards change 
would be at work. As Eysenck (3) has pointed 
out in his review of reports on the incidence 
of improvement under varying therapeutic re- 
gimes, the rate of spontaneous remission in 
untreated psychoneuroses is almost identical 
with the recovery rate reported when inten- 
sive psychotherapy has been applied. While 
Eysenck’s analysis of these reported data has 
been challenged by Rosenzweig (9), and per- 
haps cannot be considered to be compelling 
in the light of Rosenzweig’s criticisms, it is 
undoubtedly true that a substantial percent- 
age of untreated psychoneuroses and psy- 
choses make some sort of recovery. 


1‘The present investigation is one of a series of 
studies sponsored by the Kaiser Foundation, Oak- 
land, California, and supported in part by Research 
Grant MH-331 from the National Institute of Men- 
tal Health, Public Health Service. Part of the finan- 
cial support for the present study came from a grant 
of the Medical Division of the Rockefeller Founda- 
tion to the Institute of Personality Assessment and 
Research, Berkeley, California. 
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To say that a remission is spontaneous 
however, is generally to make a confession of 
ignorance; what we mean is that a change 
has occurred for reasons which we do not un- 
derstand. When a change in the psychic state 
of a patient has occurred concurrently with 
the application of psychotherapy, we usually 
feel that we do understand the causes of the 
change. Unless, however, we are certain that 
there is a significant increment in the recov- 
ery rate when psychotherapy is applied, we 
may be deceived in attributing the changes 
we have observed to the psychotherapeuti 
forces we think we have applied. Hence the 
importance of research into 
change under systematically varied conditions 


psychological 


The Present Research 


This paper reports the results of a study in 
which 150 psychoneurotic patients all drawn 
from the same clinic population were tested 
with the Minnesota Multiphasic Personality 
Inventory before and after an interval of 
time during which some of them received 
psychotherapy and some of them did not. All 
150 patients had applied for psychotherapy 
in the psychiatric clinic in which the study 
was conducted, and all of them had been ac- 
cepted for treatment; a group of 23 cases, 
however, had to be placed on a waiting list 
until therapeutic facilities became available, 
and they waited some six months before be- 
ginning treatment. Of those who received psy- 
chotherapy immediately, 85 received group 
therapy, and 42 received individual therapy: 
they included only those patients treated for 
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a minimum of three months during the pe- 
riod of time covered by the study. 

The aim of the study is to discover what 
changes, if any, occur in MMPI profiles of 
patients who receive psychotherapy, and to 
compare these changes with whatever changes 
may be observed in the MMPI profiles of pa- 
tients who during the same period of time re- 
main untreated. 

Other investigators, such as Kaufmann (5), 
Gallagher (4), Mosak (7), and Rashkis and 
Shaskin (8), have reported observations of 
MMPI changes following psychotherapy; the 
distinctive feature of the present research is 
the use of a control group consisting of pa- 
tients who are in need of therapy and who 
want it, but who do not receive it. 

The psychotherapists who worked with the 
treatment groups included psychiatrists, so- 
cial workers, and psychologists. All therapists 
had at least three years of postdoctoral or 
postgraduate training and experience. The 
theoretical orientation in individual therapy 
was psychoanalytic, although the psychoana- 
lytic method was not used. The explicit 
therapeutic strategy or time perspective for 
individual treatment varied from patient to 
patient, but what occurred generally was 
brief, ego-oriented psychotherapy on a once- 
a-week basis. Group therapy differed some- 
what in its greater emphasis upon current in- 
terpersonal] responses; i.e., the interpretations 
and focusing remarks of the therapist were 
centered on the interpersonal tactics of the 
patient in relation to the therapist and the 
five other patients in the group, the reactions 
he provoked from other group members, and 
the meaning of these interactions in terms of 
the patient’s total life situation. 


The Research Situation 


This study was done in the psychiatric out- 
patient clinic of the Kaiser Foundation Hos- 
pital in Oakland, California, and was con- 
ducted with a minimum of interference with 
the usual clinic routine. No special arrange- 
ments were made for the assignment of pa- 
tients to treatment or nontreatment groups, 
and neither patients nor psychotherapists 
considered themselves involved in a research 
program. 
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This is perhaps not the ideal design for a 
study in which an untreated control group is 
to be used to establish a base line for evaluat- 
ing the unique contribution of psychotherapy 
to the amelioration of the psychoneurosis. In 
a less real world, for example, the research 
psychologist in a clinic might assign new pa- 
tients randomly to treatment and nontreat- 
ment groups, and he might also set some 
standard interval as the period of time which 
should elapse between the determination of 
the patient’s state at the beginning and at 
the end of the experiment. The experimen- 
tal (treatment) and control (nontreatment) 
groups would then be comparable in terms of 
principle of selection, and might be expected 
not to differ significantly from one another 
in severity of initial condition, diagnosis, or 
prognosis. Furthermore, an equal length of 
time would have elapsed between ¢ — 1 (ini- 
tial state) and ¢—2 (terminal state) for 
both groups. 

Under the pressing practical demands of 
clinical work, it is difficult to arrange a re- 
search design which will satisfy perfectly 
these ideal conditions. The decision not to 
treat is always a critical one in any thera- 
peutic practice, and in psychiatric work espe- 
cially such risks as suicide, psychosis, and 
various other personal and interpersonal ca- 
tastrophes are possibly attendant upon an un- 
fortunate decision. Random selection of pa- 
tients for treatment and nontreatment groups 
is therefore not possible in a situation where 
the medical responsibility is properly the 
paramount one. 

It is also not possible to establish in ad- 
vance the exact duration of treatment. Treat- 
ment may be terminated at the decision of 
the patient at any time. Furthermore, early 
termination of treatment is sometimes indi- 
cated for technical reasons, and is brought 
about by the therapist. Again, in some cases 
the tempo of work is much slower, and treat- 
ment necessarily takes longer. Finally, acci- 
dents of circumstance, such as a change in 
residence or in place of employment, may 
operate to cause interruption of treatment be- 
fore the lapse of time specified as desirable 
for the experiment. 

In spite of these irregularities, the design 
of the present study remains fairly clear-cut. 
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As it happened, the experimental and control 
groups turned out to be quite comparable 
with one another in diagnosis, prognosis, 
severity of initial condition, age, sex, and 
education. These comparisons will be pre- 
sented below. Furthermore, the interval be- 
tween ¢ — 1 and ¢ — 2 was an average of 7.00 
months for the nontreatment group, 8.32 
months for the individual psychotherapy 
group, and 8.63 months for the group therapy 
group. These means do not differ signifi- 
cantly from one another (F of 2.5, p > .05). 


Characteristics of the Sample 


None of the patients in this study was so 
ill at the time of application for treatment as 
to require hospitalization. They were diag- 
nosed most commonly as psychosomatic neu- 
roses, obsessive or schizoid characters, or 
phobics (anxiety neuroses, etc.); less com- 
monly, as psychopathic characters or as hys- 
terics. The average age of the group was 32 
years, the average education was one year of 
college. Of the 150 patients, 97 were women; 
this preponderance of women is characteristic 
of the clinic. 

The difference in proportions of men to 
women in treatment and nontreatment groups 
was not statistically significant: women con- 
stituted 67 per cent of the nontreatment group 
and 63 per cent of the treatment group, a per- 
centage difference which gives a CR of 0.37, 
p > .05. No sex differences were found in any 
of the further comparisons presented in this 
paper, though computations were done sepa- 
rately for men and women; combined totals 
for both sexes are therefore given when sta- 
tistics are cited. 

It was indicated above that treatment and 
nontreatment groups did not differ signifi- 
cantly in age, education, or diagnosis. More 
exactly, they compared as follows: In age, the 
mean of the treatment group was 32.48, that 
of the nontreatment group 30.9; the sigmas 
were 6.8 and 5.7, respectively. In years of 
schooling, the mean of the treatment group 
was 13.6, that of the nontreatment group was 
12.8; the respective sigmas were 2.7 and 2.3. 
In diagnosis, the group percentages in the 
types of neuroses recognized in the simplified, 
MMPI-based diagnostic scheme (6) used in 


the Kaiser Foundation Psychological Research 
Project were as follows (treatment group per- 
centage given first, nontreatment group next): 
Psychosomatic 19 per cent, 18 per cent; Hys- 
teric 6 per cent, 9 per cent; Psychopathic 7 
per cent, 5 per cent; Obsessive 19 per cent, 
23 per cent; Schizoid 21 per cent, 23 per 
cent; Phobic 12 per cent, 18 per cent; Un- 
classified 16 per cent, 5 per cent. None of the 
percentage differences in any category is sta- 
tistically significant; the largest CR, that for 
the difference in the unclassified category, 
was 1.54, the others being less than 1.00. 

The patients in the treatment group who 
were assigned to individual psychotherapy 
were also compared as a class with those 
patients assigned to group psychotherapy. 
These two treatment subgroups did not differ 
significantly from one another in any of the 
comparisons presented above. Hereafter the 
descriptive statistics for the two subgroups 
will be presented in detail, since it is of some 
interest to compare the amount and kind of 
change following group psychotherapy with 
the amount and kind of change following in- 
dividual psychotherapy. 

The logic of the experiment requires that 
treatment and nontreatment groups be com- 
parable in terms of prognosis and of severity 
of initial condition, as well as of diagnosis. 
The MMPI provides a basis of comparison 
on both points. The test was scored not only 
on the commonly used clinical and validity 
scales, where scores would indicate severity 
of the psychoneurosis, but also on a new 
scale developed by one of the authors (1). 
This scale, called the Ego-strength (Es) scale, 
was designed originally to predict response of 
psychoneurotic patients to psychotherapy, and 
it proved to have substantial validity for that 
purpose in three samples beyond the stand- 
ardization sample. Its other correlates in both 
normal (2) and clinic samples led to its be- 
ing interpreted as a measure of ego strength, 
and it was accordingly so named; however, 
its most important clinical function is as a 
prognostic indicator. 

On all of these MMPI scales, then, there 
should be no difference between the treatment 
and the nontreatment groups at ¢ — 1. The 
appropriate comparisons are presented in 


Table 1. 
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Table 1 


Comparison of Treatment and Nontreatment Groups on MMPI Scales at t—1 




















Individual Group No 
psychotherapy psychotherapy treatment 

(N =42) (N =85) (N=23) 
MMPI ————__—— 
scale Mean SD Mean SD Mean SD Ft 
1. Lie 48.04 6.76 47.70 5.25 49.70 5.19 1.03 
2. F 61.00 12.01 60.14 12.16 58.74 7.94 0.28 
3. K 51.16 7.29 51.34 8.31 54.96 4.89 2.25 
4. Hs 61.40 13.61 61.18 13.19 60.04 15.43 0.08 
5. D 78.71 12.25 73.60 13.72 76.13 12.92 2.08 
6. Hy 67.21 8.87 66.40 10.38 66.87 13.78 0.08 
7. Pd 67.57 14.65 66.75 12.08 67.83 12.73 0.09 
8. Pa 63.66 10.22 61.17 10.76 62.13 8.37 0.82 
5: 73.09 13.75 69.52 12.70 72.65 12.00 1.29 
10. Sc 71.50 17.56 68.00 13.69 67.83 12.81 0.88 
11. Ma 55.88 10.51 54.80 10.32 49.96 10.05 2.84 
12. Es* 41.05 3.46 41.76 7.35 40.80 6.16 0.24 





* Raw scores rather than 7 scores are given for Es. The mean for clinic populations is 41, and the SD 7.5. 





T With df's of m1 = 2 and mz = 147, the F ratio must be 3.00 or greater to be significant at the .05 level of confidence. None 
of the F tests shown here indicate statistically significant differences. 


As Table 1 shows, the groups did not differ 
significantly from one another either in ini- 
tial severity of condition as indicated by the 
MMPI clinical scales, or in prognosis, as in- 
dicated by the Es scale. Since they were simi- 
lar also in diagnosis, and in age and educa- 
tion, it may be concluded, as far as the main 
variables relevant to this study are con- 
cerned, that all three subsamples were drawn 
from the same population. 

Since this is so, the essential conditions on 
which the groups are varied are these: (a) 
whether or not the patients received psycho- 
therapy in the interval between ¢ —1 and 
t — 2; and (6) whether the patients who re- 
ceived psychotherapy were given individual 
or group treatment. The relationships between 
these conditions and the quantity and kind 
of change, as shown in the differences be- 
tween MMPI profiles at ¢ — 1 and ¢ — 2, will 
be described next. 


Change with Psychotherapy 


For each MMPI scale, the discrepancy be- 
tween the scale score at ¢— 1 and at t—2 
was computed for each patient. If no change 
at all had been brought about by psycho- 
therapy, one would expect the mean discrep- 
ancy scores on all MMPI scales for the treat- 
ment groups to vary in a chance manner 


about zero. That such is not the case may 
be seen from Table 2. 

As Table 2 shows, a significant decrease 
occurs in the Depression, Hysteria, Hypo- 
chondriasis, and Lie scores following psycho- 
therapy, whether individual or group. With 
group psychotherapy, there is a significant 
decrease in the Paranoia and Psychasthenia 
scores as well. With both forms of therapy, 
there is a significant rise in the Ego-strength 
scores. Finally, for the individual psychother- 
apy patients there is also a significant rise in 
the K scale. 

These findings accord closely with those 
reported by other investigators. Gallagher 
(4) found, in a study of 42 university stu- 
dents treated by the nondirective counseling 
method, that D, Hs, Pt, and F scores de- 
creased significantly following therapy, while 
K increased significantly. Rashkis and Shaskin 
(8) found significant decreases in D, Hs, Hy, 
and Pt following group therapy. Mosak (7) 
found decreases in D, Hs, Hy, Pa, and Sc 
following individual client-centered counsel- 
ing in 28 cases. Kaufmann (5) studied 51 
university students who had been rated as 
“improved” following psychiatric treatment, 
and found significant decreases in D, Hs, Pt, 
Sc, Pa, and F, and a significant rise in K. 























At this point a word about the measure of 
change seems in order. Since the MMPI calls 
upon the patient to testify concerning him- 
self, and particularly concerning his psychi- 
atric condition, it is subject to all the kinds 
of distortion to which self-representation is so 
peculiarly liable. Taken in a clinic, where it 
is presumably to be scrutinized closely by 
persons who can be, or already are, very sig- 
nificant in one’s life, it is likely to become a 
communication beyond and apart from the 
overt meaning of the words. It may be a plea, 
or a reproach, or a rebuff, or an act of ad- 
miration; in brief, an interpersonal communi- 
cation which expresses something of the re- 
lationship of the individual patient to his 
therapist and to the clinic. 

This being inevitably so, it would seem to 
behoove the psychological researcher to look 
for evidence of change in other kinds of func- 
tions and performances for consideration with 
the MMPI. In the absence of such other evi- 
dence, all that one can do is keep in mind that 
there is a possibly distorting element of self- 
representation present in questionnaires. (Per- 
haps, however, rather too much has been made 
of the fakeability of tests; life itself can be 
faked, and many a “cure” is maintained for 
a time in the interests of an unresolved trans- 
ference. Furthermore, it may reasonably be 
argued that durable character traits have a 
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way of showing themselves without one’s con- 
scious or even unconscious consent, and that 
the validity of so well-studied an instrument 
as the MMPI is not likely to be massively in- 
fluenced by momentary set.) 


Percentage of Improvement 


In addition to measuring change simply by 
considering the average discrepancy score for 
each scale, it is of some interest to inquire 
into the percentage of change for the better 
on the scales which do show change. On the 
scales which most directly reflect neurotic 
symptoms of which the patient complains 
(Hs, D, and Hy), the percentage of change 
in the direction of fewer complaints ranges 
in the present study from 61 per cent to 67 
per cent. This observation concords well with 
the estimate which Eysenck reports as an 
over-all rate of improvement with therapy 
from the data he collated. His judgment was 
that an estiraate of improvement or recovery 
in two-thirds of the cases would prove “not 
very far out.” The Ego-strength scale, as a 
matter of fact, showed an increase on second 
testing in 66 per cent of the cases. None of 
the other scales changed in the “improved” 
direction in as many as 60 per cent of the 
profiles in the sample; the Lie scale, how- 
ever, did decrease on second testing more than 
twice as often as it increased (52 per cent vs. 


Table 2 


Discrepancy Scores (ky —km) on MMPI Scales for Treatment Groups and Nontreatment Group 








Individual psychotherapy 





Nontreatment group 





(N =42) (N =85) (N =23) 

MMPI — —_—_— ——-— — - 

scale Mean SD t Mean SD t Mean SD t 

1. Lie 1.79 4.46 2.57* 1.58 5.20 2.78* 3.09 4.84 2.99* 
2. F 0.74 14.67 0.32 0.32 8.07 0.36 —1.13 4.79 1.11 
i —2.71 7.48 2.32* —0.86 6.55 1.20 1.30 5.63 1.08 
4. Hs 3.73 11.29 241)" 2.50 9.59 2.39* 3.00 8.01 1.76 
5. D 8.26 15.63 3.38* 2.58 11.60 2.04* 2.74 9.66 1.33 
6. Hy 4.43 10.64 2.66* 2.51 8.23 2.79* 3.48 9.37 1.74 
7. Pd 0.57 12.45 0.29 1.19 9.19 1.19 4.57 9.47 2.26" 
8. Pa 1.69 10.58 1.02 2.09 6.99 2.74* 1.91 8.25 1.08 
9. Pi 4.00 14.44 1.77 2.58 11.54 2.05* 1.04 8.56 0.57 
10. Sc 1.38 16.52 0.53 1.01 10.80 0.86 —2.13 8.61 1.16 
11. Ma —0.52 11.26 0.30 0.22 8.71 0.23 —1.61 8.68 0.87 
12. Est —2.62 6.60 2.38* —1.40 7.14 2.10* —1.80 3.85 2.04* 





* Mean discrepancy significantly different from zero at .05 level of confidence. 


t Computations based on raw scores rather than T-scores. 
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25 per cent), but also remained the same 
much more often than did the other scales. 

The immediate general conclusion to be 
drawn from these data is that the psycho- 
therapy patients, if one is to judge from their 
MMPI performances, are less ill than when 
they began treatment. The observed changes 
are primarily of a symptomatic rather than 
of a characterological sort: the patients are 
in a better mood (less depressed), are not as 
hypochondriacal, and are both less defensive 
(as shown in the Lie scores) and less given 
to repression as a defense mechanism (the 
Hysteria scale). The increase in the K score 
in the individual psychotherapy patients no 
doubt merits special comment, especially 
since it was found to increase following ther- 
apy in some of the other studies cited. The 
common interpretation of K is that it indi- 
cates defensiveness, and that a high K score 
betokens a test-taking attitude which involves 
representing oneself in a better light than 
actual clinical condition would warrant. How- 
ever, in studies over the past five years at the 
Institute of Personality Assessment and Re- 
search, K has regularly been observed to cor- 
relate positively with favorable aspects of per- 
sonal functioning. In the present study, it 
should be noted that while KX is rising, LZ is 
falling; if indeed an attempt were being made 
by these patients to represent themselves in 
an unwarrantedly better light at second test- 
ing, one would expect L to rise as well. Per- 
haps the K scale needs a systematic re-evalua- 
tion before being accepted as a measure of 
test-taking attitude. 


Changes in the Control Group 


Patients who received psychotherapy clearly 
responded differently to the MMPI when they 
were tested at the conclusion of the therapy; 
what, then, of the patients who remained un- 
treated for a comparable length of time? Does 
time alone have an equal effect, or does treat- 
ment make a significant difference? A partial 
answer is provided by the comparable sta- 
tistics for the nontreatment group, which are 
presented in Table 2. 

From Table 2 it is evident that the pa- 
tients who were waiting for treatment had 
somewhat fewer complaints on second test- 
ing, although most of the clinical scales do 


not change significantly. On the neurotic triad 
(D, Hs, Hy) the average decrease is slightly 
greater for the controls than for the group 
psychotherapy patients. The percentage of 
change for the better in those scales averaged 
61 per cent in the control group, which is 
slightly, but not significantly, less than in the 
psychotherapy groups. There is a significant 
increase in the control group in scores on Es, 
which would suggest that at the end of the 
waiting period the patients are somewhat 
more amenable to psychotherapy than at the 
beginning of that period. The actual percent- 
age of patients who improved on Es in the 
control group was 55 per cent, compared with 
66 per cent in the therapy groups, a differ- 
ence which is not statistically significant. 

One might question at this point whether 
the patients on the waiting list should really 
be thought of as “untreated.” In a sense, of 
course, simply having committed oneself to 
participating in psychotherapy, and having 
had a reciprocal commitment from a clinic to 
afford psychotherapy, even though not im- 
mediately, represents a breaking of the neu- 
rotic circle. A force for change has already 
been introduced. In addition, the initial in- 
terview and the psychological testing may 
themselves be therapeutic events, since dur- 
ing such sessions the patient makes some ef- 
forts to confront himself and his problems 
more objectively than he has in the past. 
Moreover, the focus of the intake interview 
at the Kaiser Foundation clinic was gener- 
ally upon realistic questions concerning the 
patient’s situation and possible courses of ac- 
tion, so that even the waiting-list “controls” 
might well feel that a realistic review of their 
situation had been achieved, that an impor- 
tant decision to change had been made by 
them, and that in general they had obtained 
more control over their own lives. As the sta- 
tistics in Table 2 indicate, these changes are 
slight and are not statistically significant for 
the clinical scales (with the exception of Pd), 
but there is some change. From a methodo- 
logical standpoint, it may be suggested that 
other control groups should be added in fu- 
ture studies, since the psychological factors 
involved in being on a waiting list are them- 
selves possibly determinative of changes in 
psychiatric condition. 
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Changes in Patients With and Without Therapy 


Table 3 


Comparison of Treatment and Nontreatment Groups in 
Terms of Discrepancy Scores (kyu —kw) 
on MMPI Scales 








Individual psycho- 
therapy vs. 


Group psycho- 
therapy vs. 











nontreatment nontreatment 
Diff. Diff. 
between between 
mean dis- mean dis- 
MMPI crepancy crepancy 
Scale scores CR scores CR 
1. Z£ 1.30 1.06 1.51 1.31 
ye 1.87 0.75 1.45 1.10 
3. K 4.01 2.44* 2.16 1.58 
4. Hs 0.73 0.30 0.50 0.25 
5. D 5.52 1.75 0.16 0.06 
6. Hy 0.95 1.49 0.97 0.45 
7. Pd 4.00 1.41 2.38 1.08 
8. Pa 0.22 1.25 0.18 0.15 
9. Pi 2.96 1.11 1.54 0.70 
10. Se 3.51 0.68 3.14 1.47 
11. Ma 1.09 0.44 1.83 0.89 
12. Es 0.82 0.64 0.40 0.36 





* Difference statistically significant at .05 level. 


The question remains, is there significantly 
more change with regular and formally de- 
fined psychotherapy than without it? The an- 
swer is provided in Table 3, which presents 
comparisons of the treatment and nontreat- 
ment groups in terms of discrepancy scores. 
When the amount of discrepancy consequent 
upon nontreatment is subtracted from the 
amount consequent upon either individual 
psychotherapy or group psychotherapy, what 
remains is rarely a discrepancy of such mag- 
nitude as to be statistically significant. The 
only comparison which did yield a signifi- 
cant difference in discrepancy scores was the 
comparison of the individual psychotherapy 
group with the nontreatment group on the K 
scale; and, in that instance, the difference 
was large because in the case of the nontreat- 
ment group the discrepancy was positive (de- 
crease in K scores), while in the individual 
psychotherapy group the discrepancy was 
negative (rise in K). For the most part, how- 
ever, the changes tended to be in the same 
direction for treatment and nontreatment 
groups, and of almost equal magnitude. 
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Summary 


The results yielded by this study may be 
summarized as follows: 

1. The mean pre-post MMPI scores of pa- 
tients undergoing both group and individual 
therapy showed significant improvement on 
symptom scales. 

2. Patients who decided to enter therapy 
but who were required to wait for treatment 
showed some MMPI improvement during the 
waiting period, primarily in prognosis. 

3. The therapy patients did not improve 
significantly more than did the waiting-list 
controls. 

4. These results suggest that the use of 
“waiting-list’” controls in investigation of 
changes in therapy may be complicated by 
therapeutic factors involved in the initial in- 
take evaluations and decisions. 

5. The use of additional “nonwaiting-list 
controls” is suggested for future investiga- 
tions on the effect of psychotherapy. 


Received November 3, 1954. 
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Brief Psychotherapy and Enuresis' 


Daniel H. Harris, Richard W. Firestone, and Carl M. Wagner 


Marine Corps Recruit Depot, San Diego, California 


The present study derives from the premise 
that nocturnal enuresis in adults is primarily 
psychogenic in origin. Supporting this was the 
observation that the psychological climate in- 
duced by military training could often be 
meaningfully related to variations in the 
enuretic symptoms of Marine recruits. This 
experiment investigated the effect of a psycho- 
therapeutic situation created prior to training 
on the adjustment of such recruits. The spe- 
cific hypothesis tested was: a significant re- 
duction of admissions to the psychiatric ob- 
servation ward in which enuresis is a factor 
will result if, during the regular screening 
procedure, enuretics receive brief psychother- 
apy combining recognition and acceptance of 
their problem with specific suggestions for 
overcoming the habit. 

Two hundred recruits (ages 17 to 27) en- 
tering training with an admitted history of 
enuresis during the previous five years were 
randomly assigned to an experimental group 
(N = 100) or control group (NV = 100). The 
two groups did not differ significantly in age, 


1Qpinions or conclusions contained in this paper 
are those of the authors. They are not to be con- 
strued as necessarily reflecting the view or endorse- 
ment of the Navy Department. 

An extended report of this study may be obtained 
without charge from Daniel H. Harris, Marine Corps 
Depot, San Diego, California, or for a fee from the 
American Documentation Institute. To obtain it 
from the latter source, order Document No. 4592 
from ADI Auxiliary Publications Project, Photo- 
duplication Service, Library of Congress, Washing- 
ton 25, D. C., remitting in advance $1.75 for micro- 
film or $2.50 for photocopies. Make checks payable 
to Chief, Photoduplication Service, Library of Con- 
gress. 


education, intelligence, or degree of apparent 
neuropsychiatric involvement. 

For experimental subjects, the regular psy- 
chiatric screening interview was expanded into 
a brief psychotherapeutic session designed to 
relieve anxiety related to enuresis by means 
of a permissive and reassuring discussion of 
the symptom, plus a focusing of positive mo- 
tivation around some plausible behavioral 
suggestions for overcoming the habit. Ss in 
the control group had only the regular screen- 
ing interview. Subsequent contacts with Ss in 
either group followed a standardized pattern 
in which further attempts at therapy were 
avoided. 

On the basis of a rigid set of admission 
criteria, 20 control Ss were admitted to the 
psychiatric observation ward prior to com- 
pletion of recruit training, while only eight 
were admitted from the experimental group. 
Chi-square analysis revealed this difference to 
be significant, supporting the hypothesis at 
better than the .02 level of confidence. Ap- 
parently the therapeutic situation utilized in 
this study was instrumental in substantially 
reducing the number of ward admissions. 

Among a third group of recruits who con- 
cealed histories of enuresis at screening but 
later proved to be enuretic, the ward admis- 
sion rate was five times as high as that for ex- 
perimental and control groups combined, the 
difference being significant at the .01 level. 
This finding gives additional support to the 
main hypothesis. 


Brief Report 
Received April 19, 1955. 
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The Measurement of Depth of Interpretation’ 


Norman I. Harway,’ Allen T. Dittmann,’ Harold L. Raush, 
Edward S. Bordin, and David Rigler 


University of Michigan 


When the proponents of one viewpoint of 
psychotherapy criticize the studies of any 
other school of thought, the criticisms tend to 
fall in one or both of two classes: (a) the con- 
cepts and relationships studied are unimpor- 
tant or have only minor relevancy; (0) the 
conditions of measurement are such as to 
preclude proper investigation of the variables 
under consideration. 

The study reported here is one of a series 
of investigations of psychotherapeutic proc- 
esses (1). In these studies we have attempted 
to select variables which have theoretical and 
nractical relevance over a wide variety of 
therapeutic approaches. Furthermore, we have 
concerned ourselves intensively with issues of 
measurement. In these ways our eventual 
goals of hypothesis testing can, we hope, com- 
municate beyond the narrow barriers of school 
partisanship. 

One of the major activities of the psycho- 
therapist in the course of treating his patient 
is to engage or avoid engaging in interpretive 
behavior (5,9). Collier has presented a rather 
full discussion of the interpretive continuum 
as it relates to psychoanalytic and nondirec- 
tive therapy (2). Like Collier’s study (3), the 
present paper reports the development of a 
scale for the measurement of a therapist’s 
depth of interpretation. We felt, however, that 


1 This paper is part of an investigation supported 
by a research grant M-516 C-2 from the National 
Institute of Mental Health of the National Institutes 
of Health, United States Public Health Service. The 
authors are indebted to Dr. R. L. Cutler, Dr. W. L. 
Hays, Mr. Z. Sperber, and Miss J. V. Williams for 
their assistance in various aspects of the research. 

2Now at the University of Rochester, Rochester, 
New York. 

3 Now at the National Institute of Mental Health, 
Bethesda 14, Maryland. 


the immediate utilization of such scales for 
hypothesis testing would be premature. In 
studies of psychotherapy, as in all studies in- 
volving ratings and codings, interpretation of 
data is limited by our understanding of the 
conditions of data collection. So long as these 
conditions are not understood and accounted 
for, investigators will arrive at discrepant re- 
sults, and will question one another’s data. 

Typical among measurement issues raised 
with regard to variables in psychotherapy are 
questions concerning context, unit size, and 
method of data presentation. Each of these 
issues becomes the focus for sometimes naive, 
sometimes sophisticated criticism of published 
studies. For example, we may consider the 
kinds of statements that are apt to be made 
in discussions of research in psychotherapy: 
“The failure to provide judges with informa- 
tion as to what has gone on previously in 
therapy, makes their judgments of the be- 
havior in question meaningless” (the prob- 
lem of context); or, “What is really meant by 
the concept is not any specific, momentary 
behavior, but rather the over-all effect” (the 
problem of unit size); or, “The judges would 
have to have movie films (or recordings) in 
order to really evaluate the behavior” (the 
problem of mode of presentation). 

The specific definition of depth of inter- 
pretation used in the present series of studies 
is: “Any behavior on the part of the thera- 
pist that is an expression of his view of the 
patient’s emotions and motivations—either 
wholly or in part—is considered an interpre- 
tation. A patient has varying degrees of aware- 
ness of his emotions and motivations. Depth 
of interpretation is a description of the rela- 
tionship between the view expressed by the 
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therapist and the patient’s awareness. The 
greater the disparity between the view ex- 
pressed by the therapist and the patient’s 
own awareness of these emotions and motiva- 
tions the deeper the interpretation.” The defi- 
nition is compatible with both psychoanalytic 
and nondirective viewpoints as expressed in 
the literature (5, 9) and is sufficiently broad 
to encompass the data of a variety of thera- 
peutic approaches. 

Acceptance of the definition of interpreta- 
tion as an interaction of patient and therapist 
has certain implications for the measurement 
operations discussed above: 

(a) With regard to unit size: Since we 
could see no firm basis for an a priori choice 
as to unit, we felt that a comparison of ex- 
tremely divergent sizes would best indicate 
any effects that might go with variation in 
size. 

(b) With regard to method of presenta- 
tion: Since the variable of depth of interpre- 
tation seems in the main to deal with the re- 
lation between the content of the therapist’s 
behavior and the content of the patient’s 
awareness, we should expect little or no dif- 
ference in the evaluations obtained by using 
the typescript of an interview as compared 
with using the actual sound recording. 

(c) With regard to context: Clearly the in- 
terpretive value of a therapist’s statements is 
not determined im vacuo but in relation to the 
determination of what the patient “actually” 
means and how conscious or aware he is of 
this actual meaning. Thus, if we force judges 
to rate depth of interpretation without giving 
them information on what the patient has 
said or is saying, the ratings should have little 
or no correlation with ratings obtained when 
the necessary information is available. 


Development of Rating Scale 


Following Thurstone’s method of equal- 
appearing intervals (10), a seven-point scale 
for rating depth of interpretation was de- 
veloped. Seventy statements descriptive of 
therapist activity were sorted by two groups 
of judges, one experienced, the other naive. 
The experienced group consisted of fourteen 
staff members and advanced graduate stu- 
dents in clinical psychology, each with at 
least 100 hours of experience in psycho- 
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therapeutic practice. Eleven undergraduate 
students in the first course in psychology 
composed the “naive” judges. Judges with 
disparate experience were used in hope of 
identifying items highly communicable to a 
wide range of possible raters. 

The importance of taking judge groups into 
account was demonstrated by the fact that 
the naive judges were significantly more vari- 
able and placed significantly more items at 
the deeper end of the scale than did the ex- 
perienced judges. 

Seven of the statements had been origi- 
nally selected so as not to fit the require- 
ments of our definition; while descriptive of 
therapist activity they did not give any indi- 
cation of patient awareness or of the relation 
of the therapist’s activity to the patient’s 
awareness, e.g., “Questioning designed to gain 
information,’ “Therapist suggests that the 
patient desires to terminate therapy.” These 
seven statements offered an internal check. If 
they scaled along with our bona fide state- 
ments, the meaning of the resulting scale 
would be open to question. None of these 
“spurious” statements met our criteria for 
inclusion in the scale. 

A seven-point graphic scale was obtained. 
Nine statements were selected to exemplify 
points on this scale. The statements and their 
scale positions (running from low to high 
depth) are: 

(a) Therapist merely repeats the material 
of which the patient is fully aware (1.1). 

(6) Restatement of material of which the 
patient is aware (1.8). 

(c) Implied focusing with regard to mate- 
rial of which the patient is aware (2.3). 

(d) Therapist connects for the patient two 
aspects of the content of the previous patient 
statement (3.4). 

(e) Reformulation of the behavior of the 
patient during the interview in a way not 
explicitly recognized previously by patient 
(3.9). 

(f) Therapist comments on patient’s bodily 
and facial expressions as manifestations of pa- 
tient’s feelings (4.4). 

(g) Use of preceding patient statement to 
exemplify a process that has been building up 
during an interview and of which the patient 
is seemingly unaware (4.9). 




















The Measurement of Depth of Interpretation 249 


(4) Therapist speculates as to a possible 
childhood situation that might relate to cur- 
rent patient feeling (5.9). 

(4) Therapist response deals with infer- 
ences about material completely removed from 
the patient’s awareness (6.9). 

In the studies below the definition of depth 
of interpretation and the scale were presented 
with the statement that the nine items on the 
scale “are not inclusive of all possible descrip- 
tions of depth at these points . . . but are 
merely examples of types of things that could 
occur and where they would fall on the scale.” 


The Conditions of Measurement Study 
Design 


Sixteen raters used the scale to evaluate 
four therapy interviews, each taken from a 
different case and each involving a different 
therapist. The raters had the same qualifica- 
tions as those of the experienced judges in- 
volved in the development of the scale. The 
three sets of measurement conditions dis- 
cussed earlier were investigated. These were: 
(a) the unit of the interview to be rated— 
the individual therapist response vs. the in- 
terview as a whole, (6) method of presenta- 
tion of the interview to the rater—typescript 
vs. tape recording, (c) amount of information 
or context given to the rater—the interview 
to be rated with its preceding interview 
(preceding interview condition) vs. only the 
therapist’s responses in sequence from the in- 
terview to be rated (therapist only condition). 

The study was designed to control sys- 
tematically or evaluate the influence of raters, 
interviews and practice in the use of the scale. 
The time-consuming nature of the task did 
not allow complete control of these factors. 
A relatively great amount of time is neces- 
sary to read or to listen to a number of 50- or 
60-minute interviews. Also to be considered 
were the number of raters available with 
appropriate experience and training and the 
number of clearly recorded psychotherapy in- 
terviews obtainable. 

A 2X 2 X 2 factorial design was projected 
(each of the three variables—method of pres- 
entation, context, and unit size—was varied 
over two levels). To form a latin square such 
that each rater rated under each combination 


Table 1 


Assignment of Raters to Experimental Conditions 








Typescript Recording 
Inter- Re- Inter- Re- 
view sponse view sponse 
Context unit unit unit unit 
Therapist I* V V I 
only II VI VI II 
ITI VII VII III 
IV Vill Vilt IV 
Preceding V I I V 
interview VI II I VI 
Vil Il It VII 
Vat IV IV Vill 











* Roman numerals represent raters. 


of the experimental conditions in a different 
order than any other rater, and such that each 
combination of the experimental conditions 
was rated but once at each order position 
from one to eight, required eight raters. 
Table 1 presents the eight possible combina- 
tions of the three factors and the assignment 
of the raters to the various combinations. The 
design was replicated, giving us a total of six- 
teen raters. Kogan (7) has noted the advan- 
tages in certain instances of “confounding” in 
the design of psychological experiments. In 
the present instance, confounding of the three- 
factor interaction (Presentation x Context 
<x Unit) with the rater differences reduced 
the interviews to four and the time required 
by half.* 

When the interview was the unit rated, only 
one score was obtained from the rater. When 
the response was the unit rated, there were, 
of course, as many scores for each rater as 
there were responses. In the latter case the 
response unit ratings for a single judge were 
averaged to give a rating for the interview as 
a whole, and then mean response unit ratings 
were compared with ratings of interviews as 
units. Regardless of the method by which 


4Among the characteristics of these interviews: 
The settings were a University counseling center, a 
Mental Hygiene Clinic, an out patient clinic and a 
NP Hospital. The hours represented were the 20th, 
40th, 146th and 11th. Therapists were of analytic or 
modified analytic orientation. They ranged in experi- 
ence from less than 1 year to 10 years of therapeutic 
work. 
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these ratings were obtained, they are assumed 
to represent measurements of one aspect (i.e., 
depth of interpretation) of the same funda- 
mental variate (behavior). Although some of 
the entries in this analysis were arrived at by 
averaging a set of ratings of responses, these 
averages are not to be interpreted in the usual 
sense of representing a number of independ- 
ent observations of the fundamental variate. 
They are, instead, meant to represent only 
ratings of behavior arrived at in a particular 
way—the rating of a whole by means of rat- 
ings of component parts. 

Another problem in connection with the use 
of response units was the pertinence of depth 
of interpretation to the various responses in 
an interview. This was resolved by instruct- 
ing raters to rate each unit but to indicate 
those units or responses which they did not 
feel were ratable on this particular scale. The 
ratings to responses so indicated were consid- 
ered as “forced” ratings and were not used in 
computing the means for the response unit 
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scores nor were they used in computing inter- 
rater agreements in rating. 


Results 


As seen in Table 2, the scale of depth of in- 
terpretation significantly differentiated among 
the interviews at the .01 level. In fact, the 
variance for interviews was about twice that 
attributable to pooled experimental condi- 
tions. The experimental conditions were found 
to be a significant source of variance at the 
.01 level. Any interview by experimental con- 
dition interaction, if such existed, could not 
be evaluated. 

Variation due to sequences was not signifi- 
cant. The difference between raters within a 
sequence was significant at the .05 level. Such 
a finding could result from the use by raters 
of different portions of the scale. It need not 
affect the agreement between raters in the or- 
dering of responses or interviews on the scale. 

Unit size. Since each experimental condi- 
tion represents a specific combination of three 


Table 2 


Analysis of Variance 








Sum of Mean 
Source of variation squares df square I 

Sequences 5.69 7 81 1.89 

Raters within sequences 8.50 8 1.06 2.47* 

Total between raters 14.19 15 

Order 18 3 .06 — 

Interviews 12.64 3 4.21 9.78** 

Experimental conditions 15.23 6 2.54 5.89** 
Presentation 30 (1 30 — 
Context 49 1 49 1.14 
Units 13.32 j1 13.32 } 30.93"* 
Presentation X context 42 1 42 - 
Presentation X units 49 14 49 1.14 
Context X units .20 1 .20 —_— 

Pooled error 15.51 36 43 

Greco-Latin square error 4.61 = f 38 

Pooled rater X order interaction, 
different sequences 10.90 24 L.45 

Total within raters 43.56 48 

Grand Total 57.75 63 





* Significant at .05 level. 
** Significant at .01 level. 
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factors, the sum of the squares and degrees of 
freedom could be broken down into the com- 
ponent parts. Testing each of the component 
mean squares for the experimental conditions 
against the pooled error mean square indi- 
cates that the difference in ratings due to ex- 
perimental conditions was primarily the re- 
sult of one factor, namely, the size of the unit 
evaluated. For each interview the evaluation 
based on the interview unit was “deeper” 
than the mean of the response unit ratings. A 
further study showed that this result was not 
a function of the exclusion of forced rat- 
ings. Apparently the judge’s perception of the 
depth of an entire interview is strongly deter- 
mined by the therapist’s deeper responses. 
This finding is of particular significance be- 
cause previously many investigators have 
made the assumption that the rating of an 
entire interview was equivalent to the pooling 
of a sequence of response ratings within an 
interview in terms of some average rating. As 
Mowrer, Hunt, and Kogan note in a slightly 
different context, “the fact that a client men- 
tions one problem ten times and a second 
problem just once does not necessarily mean 
to the clinician that the first problem is ten 
times as important to the client” (8, p. 259). 

Method of presentation. It had been ex- 
pected that ratings of depth of interpretation 
would not differ when based on a. typescript 
as compared to a tape recording of a therapy 
interview. The basis for this expectation was 
the fact that this variable was primarily a 
“content” variable, that is, that its rating de- 
pended upon the actual words spoken, and 
not upon some other factor such as tone of 
voice, facial expression, etc. The analysis in 
Table 2 indicates that there is no difference 
in the ratings of interviews under different 
methods of presentation of the interview.® 
For evaluations of this particular variable, 
then, we can in the future present typescripts 
to our raters and enjoy the practical advan- 
tages stemming from the easier administra- 
tion permitted by this method. 


5 Studies of the effects of inclusion of forced rat- 
ings, and studies of the reliabilities of each of the 
methods and the cross correlations between methods 
lend further support to the conclusion that evalua- 
tions of depth of interpretation do not vary as a 
function of these alternative methods of presentation. 


Context. We turn now to the critical ques- 
tion of context. The concept of interpreta- 
tion, and the specific definition used in this 
study imply that knowledge of both patient 
and therapist activity is necessary for a cor- 
rect appraisal of the interpretive level. If our 
measurements—in this instance ratings—are 
valid, then the removal of the patient re- 
sponses should lead to different results from 
those obtained when the patient responses 
are included in the information given to the 
raters. The analysis of variance presented in 
Table 2 indicates that the expected difference 
did not occur. Furthermore the reliabilities of 
the two methods are comparable, and the 
cross correlations indicate that the methods 
are equivalent. 

As has been noted, such a finding casts 
doubt on the validity of our measurements or 
on the adequacy of the definition of the con- 
cept. A third alternative, however, suggested 
itself. It seemed possible that the raters were 
obtaining information as to the patient’s be- 
havior from the sequence of the therapist’s 
responses. To check on this, a study was done 
in which four new raters and two of the in- 
terviews were used. 

In this study all ratings were made on the 
basis of typescript and with response as the 
unit. Each rater evaluated one interview with 
only the therapist responses in sequence pres- 
ent (this is the therapist only context of the 
earlier study) and the other interview with 
only the therapist responses present but in 
random order. The order of presentation of 
interviews and of experimental conditions was 
systematically varied. 

There is no difference in the mean response 
unit ratings between ratings based on sequen- 
tial therapist only information and ratings 
based on randomized therapist only informa- 
tion. However, the analysis of interrater re- 
liability coefficients and the cross-context cor- 
relations, suggests that marked differences do 
exist between the sequential context and the 
random order context. The reliability coeffi- 
cients for sequential order were .64 and .51, 
while those for random order were .49 and 
— .03. On the other hand, none of the eight 
cross-context correlations differ significantly 
from zero, ranging from — .19 to .15 with a 
median of — .05. In other words, while raters 
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might agree within the random order condi- 
tion, there was no evidence of significant 
agreement across conditions. These data sug- 
gest that the sequence did give the judges 
enough information about what the patient’s 
behavior may have been to allow them to 
make ratings equivalent to those of judges 
who actually had read the intervening pa- 
tient response. Randomizing the sequence of 
therapist responses probably randomized the 
judge’s hypotheses about the level of aware- 
ness demonstrated by the intervening patient 
behavior. However, this conclusion was based 
on a small number of correlations, and one of 
the two correlations under random order con- 
dition was almost as high as those observed 
under sequential order. Therefore two more 
judges were asked to rate the therapist re- 
sponses in this interview under the same two 
conditions. The four additional sequential or- 
der correlations ranged from + .81 to + .52, 
confirming our previous finding. The four ran- 
dom order correlations were — .03, — .06, 
— .08 and + .24. The ten additional cross 
correlations ranged about zero, some, how- 
ever, reaching the level of statistical signifi- 
cance. These additional data allow us to state 
with increased confidence that judges were 
attempting to judge therapist’s depth of in- 
terpretation as it was defined. 

In a further effort to generalize our findings 
the basic four-judge design was applied to two 
new interviews. We were surprised to find that 
the sequential order, random order and cross 
correlation were all at the same level, median 
correlations being + .57, + .61, and + .53, 
respectively. Our present impression is that 
the therapist style in these interviews (early 
counseling interviews) will explain the result. 
Therapists sometimes recapitulate to the pa- 
tient what he was saying or doing before pre- 
senting an interpretive reaction to the pa- 
tient’s activity. Thus, information would be 
available to a judge no matter where in the 
sequence the therapist response was located. 
As a first check on this impression a count 
was made of the number of words used by 
therapists in the two studies. As expected, 
therapists in the interviews used in the latter 
study tended to make longer responses. The 
information-bearing characteristics of thera- 
pists’ communications are now being ana- 
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lyzed and further sequence studies are planned 
to test these ideas. 

Reliability and validity. It might be argued 
that the failure to find differences in the main 
study due to context is due to the low re- 
liability of our measure. One of the usual 
methods for determining reliability of ratings 
is by means of agreement between raters. Al- 
most all the reliability coefficients based on 
the ratings of two raters working on the same 
interview under the same context and pres- 
entation conditions were statistically signifi- 
cant. The median coefficient in the main study 
was .40. Reliabilities of this order are disap- 
pointing and at first glance an obvious sug- 
gestion would be to dispense with the scale. 
It must be considered, however, that what 
is represented by these numerical values is 
analogous in test development to item reli- 
ability. For example, we computed the reli- 
ability of response unit ratings of depth for 
one of our interviews on the basis of a ten- 
response segment. The means of the ratings 
for the first ten responses, second ten re- 
sponses, and so on, were obtained for two 
raters, and these means were then correlated. 
Interjudge agreement was now .74 compared 
to .36 for single response units. As in a test, 
we may increase our reliabilities by increas- 
ing the number of items, each of which may 
have rather low reliability. The problem, how- 
ever, remains: Can we study single responses, 
rather than summing or averaging over re- 
sponses? Here too, we may make use of test 
theory. Where one is interested in individual 
items, where any one judgment may be of low 
reliability, as in opinion surveys, accuracy of 
measurement can be attained through in- 
creased sampling. We have, for example, 
found that when we pool the ratings of a 
number of judges on individual items, we ob- 
tain almost perfect correspondence (rhos of 
89, .94, and .93) with the ordering arrived 
at by combined judgments of other judges 
using other methods, such as rankings and 
method of similarities by triads (4).° 


6Further confirmation of the usefulness of the 
scale appears when reliability of individual response 
items is estimated by the Horst formula (6). Analy- 
sis indicates that agreement among the judges ac- 
counted for from 39 to 62 per cent of the total vari- 
ance among items. 


The Measurement of Depth of Interpretation 


Considering the statistical significance of 
most of the coefficients, the relatively infer- 
ential and complex nature of the variable be- 
ing rated and the fact that none of the raters 
had any training in the specific use of the 
scale, the extent of interrater agreement for 
depth of interpretation is far from disappoint- 
ing. The certainty with which the four inter- 
views could be discriminated gives substance 
to this conclusion. Further, if our measure- 
ments were sufficiently reliable to differentiate 
interviews and unit size, it follows that our 
failure to find differences between the preced- 
ing interview and therapist-only context con- 
ditions cannot be attributed solely to errors 
in measurement. 

Having considered reliability, we may now 
summarize our findings concerning the va- 
lidity of the scale. The later studies indicated 
that the initial test of validity, based upon a 
comparison of preceding interview with thera- 
pist-only context conditions, was not critical. 
Further, these later results do provide evi- 
dence for validity. Frequently, in the meas- 
urement. of variables such as the one pre- 
sented here, validity is not evaluated until 
evidence is available of success in predicting 
relationships with other variables. We have 
illustrated in this paper that it is possible to 
check on validity of measurement by examin- 
ing the consistency of the measurements with 
the definition of the variable. 


Summary 


In this paper we have illustrated not only 
how different procedures of measurement lead 
to differing perceptions of the therapeutic 
process, but also how varying the measure- 
ment conditions can, in certain instances, en- 
able a check on the internal validity of the 
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concept under investigation. 


conditions of measurement 


Three of the 
method of pres- 
entation, unit size, and context—were varied 
in presenting psychotherapy interviews to 
raters. Ratings were of the depth of a thera- 
pist’s interpretations to the patient and were 
based on a seven-point scale. The four inter- 
views used were clearly discriminated. Varia- 
tions in unit size and in certain conditions of 
context led to changes in ratings of depth. 


Received October 22, 1954. 
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Responses to Imagined Auditory Stimuli as 
Compared to Recorded Sounds’ 


David R. Stone 


Utah State Agricultural College 


The use of auditory stimuli as a source of 
useful data is in the exploratory stage. Pre- 
liminary work has indicated that such an ap- 
proach can produce useful diagnostic signs, 
both for clinical and developmental analysis. 

The work to date has centered around two 
major trends, (a) presenting sounds in single 
order, requiring free associative response to 
the sounds in turn (1), and (6) presenting 
the sounds in sets, asking for multiple asso- 
ciation to the sounds taken as a whole (2). 

The present study followed the latter trend, 
and was an amplification of the multiple- 
association technique as applied to imagined 
sounds, rather than to actual recorded sounds. 
The sounds were described verbally, in con- 
trast to being played. 

In the recorded version, the subjects (220 
college students) heard a bird chirping, a 
train coming from a distance which comes 
closer until a crashing is heard, and a trumpet 
fanfare. 

The subjects for the study of imagined 
sounds were 74 students in a general psy- 
chology class. The instructions were: 


In a moment I will describe three sounds. When 
you hear the descriptions, write a story in which you 


1An extended report of this study may be ob- 
tained without charge from David R. Stone, Utah 
State Agricultural College, Logan, Utah, or for a 
fee from the American Documentation Institute. To 
obtain it from the latter source, Order Document 
No. 4591 from ADI Auxiliary Publication Project, 
Photoduplication Service, Library of Congress, Wash- 
ington 25, D. C., remitting in advance $1.25 for 
microfilm, or $1.25 for photocopies. Make checks 
payable to Chief, Photoduplication Service, Library 
of Congress. 


use the sounds as described. Tell what has led up to 
the sounds, what is happening, and how it turns 
out. You will have five minutes. For the first sound, 
imagine that you hear a bird chirping. For the 
second sound, imagine that you hear a train puffing 
in the distance. You hear the faint sound: of a 
whistle. Gradually it gets closer and closer. Then 
you hear a terrific crash. For the third sound, im- 
agine that you hear a trumpet fanfare. 


At the end of four minutes, the subjects 
were told of the time and advised that they 
would have one minute to complete their 
story by telling how it turned out. 

In terms of length, order of sounds, situa- 
tions described, characters, sound descrip- 
tions, and outcomes, the responses to imagined 
sounds were either similar to the recorded 
version, or included them plus additional 
elaboration. The use of imaginary (verbally 
described) sounds seems as productive, though 
less structured than the recorded stimuli. 

Perhaps a more subtle analysis would re- 
veal differences not now apparent. It is pre- 
sumed at present that the association to 
multiple stimuli is a more crucial element of 
these responses than whether the auditory 
stimuli are imagined or real. 


Brief Report 
Received April 25, 1955. 
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Clinical Statements as Scientific Propositions 
and Social Decisions” 


Frank M. du Mas 


Montana State University 


“Tom is a neurotic.” “Dick is to remain at 
home under the continuing care of his par- 
ents until further study of his case can be 
made.” “Harry is to be committed to the 
state institution for mental defectives.” These 
statements, though overly simplified and out 
of context, are the kinds of statements clini- 
cal psychologists must make in their routine 
professional work. Each statement is different 
from every other statement in certain re- 
spects. The statement about Tom is a more 
or less straightforward statement of a matter 
of fact. The statement about Dick is a social 
decision to withhold positive action. The state- 
ment about Harry is a social decision to 
initiate a definite course of action. The clini- 
cal psychologist is an applied scientist and 
these statements are relevant to the applied 
part of his work. He is a scientist operating 
within the confines of his social matrix and 
he is constrained to obey administrative 
protocol, the laws of his society, and to make 
decisions about a patient which may radi- 
cally change the patient’s way of life. It is 
not a question of whether or not a clinician 
wants to make these kinds of decisions. He 
must, if he is to work effectively in a social 
institution such as a hospital. 

But the clinician is also a scientist. In his 
endeavor to push back the frontiers of knowl- 
edge, he frequently resorts to theoretical 


1 This article is a major revision of a paper read 
at the 1954 Convention of the Midwestern Psycho- 
logical Association. 

2 The ideas presented here are relevant to all ap- 
plied sciences. The discussion is pointed at one par- 
ticular field, clinical psychology, in order to simplify 
the discussion. An understanding of our ideas in one 
applied science should easily transfer to other ap- 
plied sciences. 
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analysis in his study and construction of 
theoretical systems which organize and inte- 
grate his field. When he does this, he turns to 
deductive logic in order to facilitate his theo- 
retical work. He often restates an inductive 
generalization as a postulate in a deductive 
system. Then, as in all theoretical work, he 
operates within a formal system and the rules 
of the game are not quite the same as the 
rules appropriate to inductive empirical sci- 
ence or the rules of society. 

It seems, therefore, that the clinician is 
concerned with statements in three domains: 
formal, empirical, societal. What is the ap- 
propriate logical frame of reference to use in 
evaluating the validity of statements in each 
of these domains? Since, as we shall show, 
eminent authorities give quite different an- 
swers to this question, let us refine the issues. 

One widely held point of view is well stated 
by Ayer: 


Like Hume, I divide all genuine propositions into 
two classes: those which, in his terminology, con- 
cern “relations of ideas,” and those which concern 
“matters of fact.” The former class comprises the 
a priori propositions of logic and pure mathematics 
and these I allow to be necessary and certain 
That is, I maintain that the reason why these propo- 
sitions cannot be confuted in experience is that they 
do not make any assertion about the empirical 
world, but simply record our determination to use 
symbols in a certain fashion. Propositions concern 
ing matters of fact, on the other hand, I hold to be 
hypotheses, which can be probable but never certain 
(3, p. 31). 


Stated differently, what Ayer is saying is 
that formal propositions may be evaluated by 
reference to a 2-value logic, that is, any for- 
mal proposition is either true or false. In 
probability terms, the probability of any for- 
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mal proposition being true is either 0 or 1. 
Empirical propositions, however, can never be 
certainly true or certainly false—they can 
only be probable. That is, an empirical propo- 
sition has a truth value which may be repre- 
sented by a point in a truth continuum. In 
probability terms, the probability of an em- 
pirical proposition being true is always greater 
than O but less than 1. The truth (or prob- 
ability) continuum implies that a multivalue 
logic is necessary for the evaluation of em- 
pirical propositions because a continuum con- 
tains an infinite number of possible points or 
truth values. 

Another point of view maintains that it is 
possible to evaluate a proposition about an 
object, person, or event as either certainly 
true or certainly false. This point of view is 
implicit in the writings of Allport: 


The truth of the matter seems to be that this delin- 
quent has either 100 per cent certainty of becoming 
a repeater or 100 per cent certainty of going straight 
(2, p. 156). 


In another source Allport states: 


Indeed, if we believe in determinism at all, his (the 
parolee) chances are either zero or 100: he is bound 
to succeed or else to violate . . . and (ideography) 
will bring your prediction ... to a 100% certain 
individual prediction (1, p. 17). 


Others agree with Allport. Snygg and Combs 
state: 


Far from being inconsistent, behavior becomes char- 
acterized by complete predictability (4, p. 58). 


Snygg and Combs (4, p. 437) affirm their 
agreement with Allport and include a quota- 
tion from his work. 

Stated differently, what these writers are 
saying is that empirical propositions may be 
evaluated by reference to a 2-value logic, 
that is, that it is at least sometimes possible 
to say that an empirical proposition is cer- 
tainly true or certainly false. In terms of 
probability, they say the probability of some 
empirical propositions is either O or 1. 

These representative quotations raise cer- 
tain questions which need to be answered. 
What logical frame of reference is appropriate 
to formal statements? To empirical state- 
ments? To societal statements? How many 
and what kinds of logical frames of reference 
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Table 1 


Logical Frames of Reference and Their Applications to 
Specific Clinical Statements 








Relations Truth values* Applications 
I 0< p< All clinical statements 
I (F) (T) Formal propositions 
iil p=0, 1 Formal propositions 
IV 0<p<i Empirical propositions 
V (F) (D) (T) Subjective social decision : 
withholding action 
VI 0<F|D|T<1 Objective social decision: 
withholding action 
Vu (F) (T) Subjective social decision : 
action 
Vill 0<F|T<!1 Objective social decision: 
action 





* Parentheses represent discrete truth values; vertical lines, 
cuts in the truth or probability continuum. 


are required by the clinician? Can a unitary, 
systematic integration be made of the several 
logical frames of reference? 

Let us attempt to answer these questions. 


Analysis and Development 


The most general model of our ideas is 
shown in Table 1, relation I. It states that 
for any proposition the probability, p, of it 
being true is some value equal to or greater 
than zero and equal to or less than one. 
Classical logic holds, however, that there are 
two truth values, i.e., false, F, or true, T; as 
shown in Table 1, relation Il. We know now 
that relation II is relevant to formal propo- 
sitions only. But relation I implicitly contains 
relation II since by simple translation we get 
relation III. That is, the limits of the truth 
or probability continuum suffice for the truth 
values of classical Aristotelian logic. 

But no empirical proposition is ever cer- 
tain, that is, p can never be O or 1 for such 
propositions because (a) there always seems 
to be error in human observations, (5) no 
empirical proposition is ever regarded as ab- 
solutely true or absolutely false by all those 
competent to judge, i.e., by all scientists at 
all times, and (c) all possible observations 
never have been and never will be made re- 
garding any empirical matter. Item c seems 
to be true because (4) positive or negative in- 
stances may occur in the future and (#) even 
in a specified time interval in which observa- 














Clinical Statements: Scientific and Social 


tions are made, all possible observations are 
not made nor do all scientists at that time 
make observations of the specified phenome- 
non; therefore, negative or positive instances 
could occur in the present, could have oc- 
curred in the past, and could occur in the fu- 
ture. Hence, that part of relation I which is 
appropriate to empirical propositions is given 
by relation IV. 

In the practical world of affairs, instances 
constantly arise about which the clinician 
wishes to postpone judgment or opinion until 
he has obtained more information, made more 
observations, consulted with others, and 
weighed the evidence before he makes a diag- 
nosis, decides on appropriate therapy, or initi- 
ates a course of action. When such instances 
arise, the clinician often makes a subjective 
analysis of a patient’s case history, test re- 
sults, present behavior, etc. For example, in 
the case of Dick the clinician’s judgment was 
to postpone or withhold a definite course of 
action. The empirical proposition on which 
his decision rests might be something like 
“Dick is psychotic.” At the time a subjective 
social decision had to be made, the proposi- 
tion “Dick is psychotic” remained in doubt. 
He requires, therefore, a 3-value logic: false, 
doubtful, and true. Relation V is the appro- 
priate logical frame of reference in this in- 
stance. However, when an acceptable estimate 
of p can be calculated, three intervals of rela- 
tion IV can suffice for the three discrete truth 
values of relation V. The calculated estimate 
of p would permit an objective social decision 
to be made that definite action should be 
withheld in Dick’s case if p fell within the D- 
interval of relation VI. 

It seems obvious that a 3-value logic is a 
cautious guide to decision making in a practi- 
cal world of affairs. It permits us to postpone 
a decision until we are surer of the factors in- 
volved and their relative weights. But sooner 
or later the clinician is forced by the demands 
of the society in which he lives and works to 
make another kind of decision. That is, so- 
cietal demands often force him to say “yes” 
or “no”; this will work or that will not work. 
He must decide whether a person was or was 
not morally responsible at the time of a crime, 
whether a patient is or is not a schizophrenic, 
whether a person is or is not to be committed 
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to a mental hospital, whether a person will 
or will not violate his parole, whether a pa- 
tient is or is not to be released from the hos- 
pital, etc. The clinician must make many 
decisions of an “either-or” nature. The state- 
ment regarding Harry is of this sort. 

At first glance it may seem that a 3-value 
logic also would be appropriate to a social 
decision initiating a definite course of action. 
But there are serious theoretical as well as 
practical limitations involved. Situations often 
arise where “close” decisions have to be made. 
The D-category of relation V or the D-in- 
terval of relation VI may be so wide that a 
proposition must remain forever in doubt. 
His files would become full of unresolved 
cases. Before long, social pressures (adminis- 
trative, parental, legal) would be brought to 
bear on him to make definite decisions re- 
garding these cases. 

The empirical propositions upon which the 
statement about Harry rests is “Harry is a 
mental defective.” The social rule, say, 
that all those classified as mentally defective 
must be committed to the state institution for 
mental defectives. The clinician may study 
at great length all available information re- 
garding Harry and then make the subjective 
social decision that Harry is a mental defec- 
tive and, therefore, must be committed to the 
state institution. Relation VII is applicable 
here. However, when the clinician can calcu- 
late an estimate of p, he may define two 
intervals of relation IV and relation VIII re- 
sults. Relation VIII is useful in making ob- 
jective social decisions which initiate a defi- 
nite course of action. 

The preceding development indicates that 
of the many possible frames of reference (1-, 
2-, 3-,. .. , m-value), there are three which 
have particular relevance to clinical state- 
ments: 2-value or 2-interval, 3-value or 3- 
interval, and multivalue. The concept that 
unifies them all is the truth or probability 
continuum. 


Summary 


The clinical psychologist must serve two 
masters: science and society. His professional 
statements will fall in three domains: formal, 
empirical, and societal. Statements with so- 
cietal significance are often implictily based 
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upon empirical propositions. Each formal or 
empirical proposition can be regarded as hav- 
ing a certain probability, p, of being true. 
The general model is the truth or probability 
continuum: 0=pS1. Clinical statements 
about a patient are directly or indirectly em- 
pirical propositions. 

A clinician has two kinds of social decisions 
to make about a patient: to withhold a course 
of action or to initiate a definite course of ac- 
tion. His subjective social decisions require a 
3-value logic (false, doubtful, true), when- 
ever he wishes to withhold action. His subjec- 
tive social decisions require a 2-value logic 
(false, true) when he must initiate a definite 
course of action. He can, however, make ob- 
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jective social decisions whenever an estimate 
of p can be calculated. The 3-value and 2- 
value logics may then be regarded as 3-inter- 
vals and 2-intervals respectively of the prob- 
ability continuum. 


Received December 8, 1954. 
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Delayed Gratification and Ego Development: 


Implications for Clinical and Experimental 
Research 


Jerome L. Singer 
Franklin D. Roosevelt VA Hospital, Montrose, New York 


Since its initial delineation in Freud’s The 
Interpretation of Dreams (13), the concept 
of delayed discharge has played a pivotal 
role in the psychoanalytic theory of ego de- 
velopment and the psychology of thinking. 
Little attempt has been made, however, to 
explore some of the implications of this con- 
cept and to deduce testable hypotheses or to 
survey systematically some of its parameters 
in relation to views held by other theorists in 
psychology. The last decade has witnessed 
a marked increase of interest in ego func- 
tions and a consequent coalescence of psy- 
choanalytic theory and general psychology. It 
now seems possible to attempt at least an ini- 
tial survey of the scientific usefulness and va- 
lidity of Freud’s view of delay. In the present 
paper the concept of delay will be related to 
the views of other theorists, relevant empirical 
evidence will be cited, and some implications 
both for further experimentation and practi- 
cal utility will be suggested. 


Origins in Psychoanalytic Theory 


The distinction between primary and sec- 
ondary processes in mental functioning has 
been described by Jones (22) as one of 
Freud’s most profound formulations. The 
shift from the chaotic, associative, diffuse, 
and “syncretic” character of primary-process 
thinking to the more synthetic, goal-directed, 
reality-oriented secondary process involves as 
a key step the enforced delay or deferment of 
gratification (13). As Freud described the se- 
quence of thought development, the gradual 
internalization of the delaying mechanism 
provided the clue to the emergence of the re- 


ality principle (11). The arousal of a need- 
tension pressing for discharge results in the 
infant in a restless discharge of motor ac- 
tivity which eventually subsides upon con- 
tact with the satisfying object, e.g., bottle or 
breast. When such restless motor activity has 
been repeated frequently in association with 
the satisfying object, the absence in reality 
of the object will lead to its hallucinatory 
representation as soon as the motor innerva- 
tion is initiated by the aroused need. This 
step is part of the primary process and re- 
flects the operation of the pure pleasure prin- 
ciple. It can be seen clearly in evidence in the 
autistic perceptions of psychotics, wish-f 
filling dreams, and hallucinatory food re- 
sponses of starving castaways. Cathectic en- 
ergies are still mobile and pressing for 
immediate discharge at this stage; hence, the 
ease with which things can stand for other 
things associated with them only by spatial 
or temporal contiguity. Chaplin’s movie, The 
Gold Rush, portrays this most acutely and 
humorously. The little tramp with his jerky, 
restless movements is suddenly transformed 
into a juicy fowl in the eyes of his starving 
companion in the snowbound cabin. 

Freud at no time brought together all the 
steps involved in the shift from the halluci- 
natory representation of the absent drive ob- 
ject to the internalized control of discharge 
through thought process. Nevertheless, the 
sequence roughly gleaned from a number of 
different papers seems to involve a gradual 
“neutralization” of libidinal energy through 
identification and incorporation of parental 
figures, transformation of 


ful- 


mobile energies 
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into “bound cathexes,” and formation of a 
functional substructure of the personality, 
the ego, whose properties include motor con- 
trol, purposive action, directed thought, re- 
ality-cognition, and various defensive meas- 
ures which organize or segmentalize the 
diffuse innervations arising from basic drives 
(id) (9, 10, 11, 12, 13).* As early as 1900 
Freud had already suggested that the tran- 
sition from mobile to bound cathexes made 
possible the use of small, controlled energy 
expenditures at the behest of the secondary 
process which could serve as signals (13), or 
as he put it later, “experimental actions” 
(11). In effect the secondary process substi- 
tutes a “thought identity” for the hallucina- 
tory wish fulfillment. Freud wrote, “All think- 
ing is no more than a circuitous path from 
the memory of a satisfaction (a memory 
which has been adopted as a purposive idea) 
to an identical cathexis of the same memory 
which it is hoped to attain once more through 
an intermediate stage of motor experiences” 
(13, p. 602). 

Subsequent psychoanalytic theorists have 
not altered Freud’s concepts to any great 
degree. A brief but stimulating paper by 
Ferenczi (7) carries Freud’s concepts to the 
clinical sphere and points to some individual 
differences in motor activity which are co- 
ordinated with differences in thought produc- 
tion. Ferenczi cites an example of a patient 
whose constant foot wiggling would stop 
whenever she began to think consciously. It 
became possible for the analyst to use this 
cessation of motor activity as an indication 
of resistance if the patient failed to communi- 
cate verbally the thoughts that had followed 
upon her decreased motor response. Fenichel 
(6), too, has elaborated on Freud’s concep- 
tions without, however, altering their se- 
quence or structure to any significant degree, 
while Anna Freud (8) in her work has em- 
phasized what Hartmann (16) would call the 
“conflictual ego-sphere” and deals with fan- 


1 The meaning of the concept of free and bound 
cathexes, attributed by Freud to Breuer, is never 
completely clear in Freud’s writings. Breuer (3) 
seems to have linked “bound cathexes” to “tonic 
excita*ion of nervous tension,” a phrase of interest 
chiefly because of its at least superficial similarity to 
Werner’s “sensory-tonic theory of perception” (58). 
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tasy (denial) or hypercathected thought proc- 
esses (intellectualization) only in their de- 
fensive role. 

The recent work of Hartmann (16), Federn 
(5), Weiss (56), Hartmann, Kris, and Low- 
enstein (17), Kris (24), and Rapaport (39, 
40) has added new breadth to Freud’s con- 
ception of the ego. Rapaport (39), in par- 
ticular, has taken an extremely significant 
step in the direction of providing a system- 
atic, scientifically verifiable formulation of 
Freud’s concept of delayed discharge. He 
traces the meaning of this concept at differ- 
ent vantage points: genetic (primary to sec- 
ondary process), topographic (unconscious or 
preconscious and conscious), structural (ego 
functions), economic (mobile to bound ca- 
thexes or delibidinized energies), and bDiologi- 
cal (adaptive nature of delay and thought). 
By this analysis it becomes possible to see 
more clearly the relationship of the psycho- 
analytic theory of thinking to the work of 
others less oriented toward concern with the 
“neutralization” of instinctual energies but 
more with the adaptive function of thought 
in biological survival and interpersonal rela- 
tionships. Rapaport writes, “Thinking ex- 
plores the possible pathways of action to find 
the one of least resistance, least danger, and 
greatest directness, while preserving almost 
intact the energy necessary for motor action” 
(39, p. 169). This formulation, in essence un- 
changed from Freud’s formulations in 1900 
and 1911, is nevertheless an advance in clari- 
fying the concept of delay without the con- 
fusing terminology rooted in Freud’s vaguely 
defined cathectic dynamics. Rapaport’s huge 
volume (40) contains a challenging presenta- 
tion of the hierarchical, almost functionally 
autonomous structures of motives and thought 
processes in the personality structure. 


Other Viewpoints of Delay and Thought 


The belief that conscious thought or fan- 
tasy bears some relation to the inhibition of 
an overt motor response directed toward some 
sort of gratification has appeared in the writ- 
ings of many investigators who worked more 
or less independently of psychoanalytic the- 
ory. The early American functionalists and 
behaviorists held similar views, even if we 
except the somewhat extreme and experimen- 
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tally unsupported approach that thought was 
nothing more than implicit movement of the 
speech mechanism. James (21) saw “verbal 
imagination” as the outcome of “suppressed 
articulation” while Dewey (4) claimed that 
thinking becomes intensified upon the inter- 
ruption of a usual sequence of motor acts. 
Washburn (55) held a somewhat similar 
point of view, noting also that consciousness 
and “associative activity” diminish with the 
overt performance of the act. E. B. Holt, an 
early pioneer in the integration of Freudian 
theory with the emerging American behavior- 
ism, wrote in 1915: 


Thought is ...more than the thing thought 
about: there is active thinking about objects. If we 
look once more at the least manifold in which cog- 
nition occurs—a living organism in, and responsive 
to, an environment—we see that this further ele- 
ment is the active play of motor attitude, which 
eventually resolves itself into the less labile but more 
forceful phenomenon, conduct. Thus, thought is 
latent course of action with regard to the environ- 
ment ..., or a procession of such attitudes (19, 
page 98). 


The theories of the behaviorist and func- 
tional psychologists, while less comprehensive 
in their implications than the psychoanalytic 
theory, have led at least to some experimen- 
tal research. These investigations, as summa- 
rized by Vinacke (54), have indicated that 
thought is indeed accompanied by some im- 
plicit muscular activity albeit by no means 
has it been shown to be clearly the result of 
such activity. 

More directly related to the psychoanalytic 
theory, both in influence and implications for 
a personality theory, are views held by im- 
portant workers in developmental psychology 
like Piaget (36), Werner (60), Lewin (29), 
Murphy (35), and Luria (30). All of these 
investigators present empirical data to sup- 
port a view that thought involves the gradual 
interiorization of motor response or speech 
which must be inhibited from overt expres- 
sion because of social restraints or pressures. 
Luria (30), for example, describes the change 
with increasing age of children from the vigor- 
ous acting out of a battle scene to its repre- 
sentation in drawing with minimal accom- 
panying speech or motor activity. Piaget (36) 
has traced the change in children’s language 
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from the egocentric comments in which every- 
thing that comes to mind is pronounced aloud 
without regard for its implications. Socializa- 
tion enforces inhibition of a great deal of this 
speech pattern with the consequent heighten- 
ing of thought activity, conscious and uncon- 
scious. Wolff and Precker (64) describe the 
sequence of development in terms of the 
changing reaction of the growing child in re- 
sponse to being struck: at one stage he re- 
sponds with a direct counterblow, later he 
may verbally abuse the assailant, and finally 
he may completely inhibit or delay overt re- 
sponse but fantasize various countermeasures 
Perhaps most precise in its derivation and 
fruitful in terms of experimental research 
relevant to the Freudian concept has been 
the work of Werner (58) and Werner and 
Wapner (61, 62, 63). Building in part on 
earlier physiological investigations as well as 
upon Werner’s (60) extensive survey of de- 
velopmental patterns, these writers have for- 
mulated a sensory-tonic theory of perception 
which offers at least the possibility of a more 
precise ultimate formulation of Freud’s view 
of delayed discharge in operational, experi- 
mentally verifiable terms. Werner and Wapner 
describe perception as a function of the dy- 
namic interaction of externally derived sensa- 
tions and pre-existing tonic states in the or- 
ganism. Both sensory and tonic events have 
equivalent functions in the economy of the 
organism and may serve vicariously as su 
stitutes for each other. When available en- 
ergy is not released in bodily movement the 
tonicity will express itself in perceptual dis- 
placement, e.g., illusory motion, or, perhaps 
one might add, “movements in the mind’s 
eye,” fantasies of motion. There has been an 
increasing body of experimental literature in 
support of such a theory of the “vicarious 
channelization” (62, 63). As an example, the 
finding reported by Goldman (15) may be 
cited. Subjects responded to the autokinetic 
phenomenon under immobilization, control, 
and heightened motor activity conditions. 
Readiness to perceive motion was greatest 
under immobilization, less under a control 
condition, and least during activity. The the- 
ory and experiments of Werner and his col- 
leagues thus offer a challenging opportunity, 
but their demonstration of blocked motor 
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discharge leading to perception of movement 
must still be related more clearly to height- 
ened imaginativeness if the Freudian con- 
cepts are to be assimilated into their structure. 


Experimental Research with Rorschach’s 
Movement Responses 


Perhaps the most striking possibility for 
operational expression and experimental study 
of the concept of delay has come in research 
with the Human Movement response of the 
Rorschach test. Rorschach (41) in his studies 
of responses to inkblots delineated a type of 
response which involved perception of humans 
in action (M). He dealt at great length with 
his observations that persons who saw several 
such M responses on a blot series tended, on 
the one hand, to be relatively stable or in- 
hibited in motor activity and, on the other 
hand, rather imaginative, given to consider- 
able inner living and creativeness or planful- 
ness. In effect, Rorschach, although lacking 
a clear-cut theory, was formulating a triadic 
linkage of motor inhibition, perception of mo- 
tion, and imagination or inner life. Here then 
appears a possible bridge between the psy- 
choanalytic concept of delayed gratification 
(inhibition of motor response) and the sen- 
sory-tonic theory of vicarious functioning of 
motor activity and motion perception. The 
relationship has indeed been emphasized by 
Rapaport’s (40) concern with the delaying 
capacity of M-type individuals and by Wer- 
ner’s (59) work comparing Rorschachs of hy- 
peractive and motorically-phlegmatic feeble- 
minded children. 

The heuristic value of Rorschach’s M re- 
sponse lies in two separate if ultimately re- 
lated directions. On the one hand we may 
attempt to test both Werner’s and Freud’s 
hypotheses fairly directly by observing what 
effects emerge when motion is inhibited prior 
to or during a Rorschach examination. If this 
delayed discharge of motor activity has the 
implications described above then, an increase 
in M responses should be a consequence of 
this inhibition. On the other hand, on the as- 
sumption of individual differences in ego or- 
ganization and control, it is likely that long- 
standing patterns of motor inhibition or hy- 
peractivity will be reflected in differential 
Rorschach patterns. Thus, studies of sub- 


jects who contrast sharply in Rorschach M 
or in imaginativeness or motor control may 
throw valuable light on the nature of the de- 
laying mechanism. The first experimental ap- 
proach is chiefly of theoretical interest and 
ultimately may lead to the crucial experi- 
mentation upon whose results the theory of 
delay and thought may stand or fall. The 
second hypothesis, while less crucial theo- 
retically, has important practical implications 
including the possible development of measur- 
ing devices for the vital ego function of delay 
of gratification and effective use of planning 
and imagination. 

Turning first to the direct consequences of 
motor inhibition or delay, two experimental 
studies have reported increases in Rorschach 
movement responses of normals following pe- 
riods of motor inhibition, i.e., standing rigidly 
in awkward postures or voluntary slow writ- 
ing (32, 48). Another study has investigated 
the effects of speeding up or slowing down 
tempos of Rorschach response and has yielded 
the conclusion that production of M responses 
is indeed related to tendencies or capacities 
to delay response (45). Further work remains 
to be done but it seems clear that so far the 
linkage of delay of motor discharge and mo- 
tion perception and imagination can be dem- 
onstrated directly in normal adults. No work 
with children has yet been carried out in this 
direction. A number of studies do suggest that 
the M response emerges most clearly in age 
groups that are being subjected to the first 
striking enforced socialization and motor re- 
straint of school entrance (28, 58). It can be 
said that Freud’s early formulation of thought 
as arising from delayed gratification and dis- 
charge of minute quantities of energy in ex- 
perimental action is certainly consistent with 
these findings. Whether the subtler refine- 
ments of the theory such as the transforma- 
tion from mobile to bound cathexes or the 
desexualization of energy leading to hyper- 
cathecting of ideational representations can be 
expressed in operational terms and tested ex- 
perimentally remains to be seen. Holt (20) 
has suggested some possibilities in this con- 
nection. 

The second general avenue of exploration 
in this field has been more thoroughly trav- 
ersed because it calls for correlational pro- 
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cedures rather than direct experimental ma- 
nipulation. Can it be shown that individuals 
who are given to or capable of extensive im- 
pulse control, deferment of gratification or 
motor control (apart, that is, from athletic 
skill), will reflect correspondingly both low 
thresholds for perception of motion and 
greater imaginativeness? In effect this im- 
plies that some people do manifest a per- 
sistent style of coming to terms with their 
environment which involves relative delay of 
immediate reactions to needs or provocative 
stimulation and employment of planfulness 
or fantasy in their mode of relating. Ror- 
schach’s distinction between the introversive 
and extratensive experience-types is clearly 
an example of such a cognitive style and the 
testimony of various experienced Rorschach 
authorities certainly confirms this dimension 
of personality variation (2, 23, 38, 42). 
Actual systematic investigations have linked 
characteristic modes of motor reactivity to 
Rorschach movement responses (1, 59). It 
has also been observed that both normal and 
schizophrenic subjects who yield numerous M 
responses are more capable of inhibiting mo- 
tor responses on slow-writing tasks or are 
less active and responsive to environmental 
stimuli while observed in a waiting room (32, 
47, 49). The other aspect of this relationship, 
M and creativity or imaginativeness, cannot 
be studied directly. Measures such as the 
ability to transcend objective stimulus ma- 
terial in thematic apperception stories which 
may be considered reasonable approximations 
of this fantasy capacity, have, however, uni- 
formly revealed significant correlations be- 
tween M and imaginativeness, even with gen- 
eral intelligence controlled (1, 18, 37, 43, 44, 
47, 53). Recently Singer and Herman (47) 
reported data revealing that schizophrenics 
differing in M responses differed correspond- 
ingly in a series of situations tapping motor 
control, imaginativeness, spontaneous motor 
activity, and impulsivity. The results sug- 
gested that a common factor does indeed 
link motility, motion perception, and thought 
as characteristic ego functions. Motor inhibi- 
tion has also been related to cognitive inhibi- 
tion, the tendency to delay verbalization of 
an old association and to rapidly substitute 
a new one (31). Finally, some recent work 
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has shown Rorschach’s M to be related to 
high levels of aspiration, planning ability, 
and impulse control (51). 

It should be noted, however, that none of 
the linkages reported in this section represent 
extremely high correlations. As a matter of 
fact, considerable variability is present and it 
is certain that numerous factors ranging from 
influences of other spheres of ego functioning 
(16) and from direct situational factors in 
the face-to-face subject-examiner relationship 
modify the emergence of the cognitive style 
in question. It may be concluded, neverthe- 
less, that in general the capacity or tendency 
to delay response or inhibit motor discharge 
appears to be a characteristic adjustment of 
many persons and it is linked in them with 
tendencies to be sensitive to movements on 
ambiguous forms or to engage in fantasy ac- 
tivities with relative ease. 


Some Genetic Considerations and 
Clinical Implications 

Accepting at least temporarily the last con- 
clusion, what can be said of the way in which 
these characteristic modes of coming to terms 
with the environment originate? It seems 
likely that many temperamental character- 
istics, particularly gross features such as rela- 
tive motility tendencies (in which large dif- 
ferences emerge in children [57]) may be 
constitutionally based. Certainly Freud (12) 
came to feel that quantitative factors in libido 
distribution were of such a nature. Neverthe- 
less, one is tempted to seek for considerable 
additional sources of individual variability in 
acquired characteristics, modes of adjustment, 
defensive techniques, or values learned from 
significant interpersonal situations in the 
family constellation. One may well ask, what 
sort of relationships in the family setting 
foster in the child a capacity to defer gratifi- 
cation or to temporarily restrain motor dis- 
charge in response to a need with subsequent 
resort to the realm of imagination or trial ac- 
tion? A clue is forthcoming in Freud’s stress 
on identification as a means of neutralizing 
libido and establishing ego defenses and coun- 
tercathexes. In family constellations where 
relatively strict patterns of eating, toileting, 
washing, napping, and recreation are the rule 
children may more readily, in order to master 








264 


their tensions, learn to accept delay since the 
sequence or pattern is consistent. In thus de- 
laying and striving to imitate the adults they 
find that resort to the level of fantasy gratifi- 
cation is possible and is frequently rewarded 
by parental figures or leads to new pos- 
sibilities for mastering the reality situation. 
Thought and delay become valued (ca- 
thected) and organized and a new hierarchi- 
cal structure of personality emerges, Lewin’s 
level of irreality (29). Within reasonable 
limits this pattern is highly adaptive and, 
indeed, one of the most uniquely human 
characteristics for it frees man from depend- 
ence upon immediate stimulation. Yet it can 
be carried to excess, as in the case where the 
extreme anxiety of parents leads to overly 
rigid patterns with the result that unceasing 
resort to inhibition and delay leads the child 
into obsessional rumination that gradually 
loses its reality orientation and creativity. 
Lair (26) has presented a review of con- 
siderable theoretical material and some data 
which support the view that an opportunity 
for identification with benign and loving 
adults in very early childhood is essential 
to the development of capacities for motor 
inhibition and planful fantasy. Goldfarb’s 
studies of adolescents whose first three years 
of life had been spent in institutions where 
close relationships with adult figures were 
not possible are highly suggestive in this con- 
nection. These institutional children showed 
almost uniformly a thinking disorder char- 
acterized by lack of time perspective, hyper- 
activity, absence of “normal inhibitory pat- 
tern,’ and lack of planfulness (14). Kup- 
per (25) has traced in detail how certain 
types of family constellation lead to develop- 
ment of strong intellectual values and in- 
hibited motor patterns. The work of Mowrer 
(34) on language development has repre- 
sented perhaps the first systematic attempt 
to develop more precisely the manner in 
which symbolic behavior is learned through 
attempted identification with the secondary 
reinforcing characteristics of benign parental 
figures. Mowrer’s formulations in the frame- 
work of two-factor learning theory certainly 
afford the possibility of expressing some of 
the analytic concepts of identification and 
“hallucinatory representation” in operational 
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terms and may open this area to experimental 
study. 

To some extent, it would appear, then, that 
the varieties and opportunities for parental 
identification may play a role in the capacity 
to develop delaying mechanisms and suitable 
imaginative processes. To the extent that so- 
cial class factors play a role in the organiza- 
tion of family constellations these factors may 
markedly influence the relative resort to de- 
ferred gratification patterns. The middle class 
family with its routines, family unity at meal- 
times, and general emphasis on saving or edu- 
cation provides the child with a setting that 
fosters such delay. This is particularly the 
case since the consistency of the pattern leads 
to the relative assurance that satisfaction will 
come eventually. In the lower class family 
parents are less available (particularly fa- 
thers), meals are haphazard with no assur- 
ance of their being forthcoming, and the 
value of delay is less clear to the child. Hence 
we may anticipate that lower class children 
will show different patterns of means-end 
cognizance, time evaluation, and imaginative- 
ness. Some tendencies of this sort have in- 
deed been reported in the recent literature 
(27, 35, 46). 

Returning to the Rorschach movement re- 
sponse as a possible measure of delaying ca- 
pacity and fantasy we might expect that 
high-M subjects would show more positive 
feelings toward parents or at least greater 
identification with them. Studies with the 
TAT have offered some supporting results 
but considerably more work remains to be 
done here (44, 50). It would be important to 
study known family constellations and ob- 
serve the patterns of delay, motor inhibition, 
or fantasy which emerge in the children. One 
possibility might be exploration of cultural 
groups known to differ markedly in family 
structures, e.g., Irish and Italian lower class. 

In conclusion, then, it seems plain that 
Freud’s original concept of delayed gratifica- 
tion leading to thought as experimental ac- 
tion is indeed a fruitful one. It is supported 
in rough outline at least by the observations 
of a host of investigators and by considerable 
experimental research particularly that with 
the Rorschach M response. The dimension of 
motor inhibition—motion perception—fantasy 
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seems a strikingly useful one, capable of em- 
pirical study and providing an interesting ap- 
proach to the study of personality structure 
in the family setting. The concept of delay or 
impulse control as a basic ego function af- 
fords also a highly significant contact point 
between psychoanalytic theory and general 
psychology. More than fifty years after its 
original pronouncement, Freud’s theory of 
thought development is vigorously alive and 
beckons toward new vistas of research. 


Summary 


This paper represents an initial attempt to 
place Freud’s concept of delayed gratification 
and thought development in the perspective 
of a broader framework of theory and re- 
search in psychology. After tracing the de- 
velopment of this concept in psychoanalytic 
literature, points of contact with early Ameri- 
can behaviorist and functional psychological 
points of view were noted. Experimental re- 
search that bore on the theory was cited with 
particular emphasis on Werner’s sensory-tonic 
theory of perception and the empirical data 
which has grown out of Rorschach’s linkage 
of motor inhibition, motion perception, and 
imagination. Some implications of this con- 
cept for the study of identification processes, 
internal control mechanisms, and differential 
parental influences in the family constellation 
were suggested. 


Received November 5, 1954. 
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Testing Behavior Hypotheses with the Rorschach: 
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Interest in the Rorschach as reflected in 
the literature, both in theoretical formulation 
and report of empirical findings, is extensive. 
Systematic empirical approaches, however, 
have been few, and are primarily those in- 
volving factor analysis of Rorschach scores 
(6, 11), or of these scores in conjunction with 
other scores such as intelligence test perform- 
ance (10). The scoring categories or diag- 
nostic signs which have been included in the 
matrix of intercorrelation have not been 
identical, and where there has been replica- 
tion of the study, at least reasonable replica- 
tion of factor structure has been found (10). 
Factors identified thus far have tentatively 
been identified with such names as produc- 
tivity, movement, lack of perceptual control, 
shading, intelligence, organic pathology, loose 
conceptual thinking, color awareness and color 
use, popular response, psychoneurosis, and 
confused succession. What factors are found 


1This research was supported in part by the 
United States Air Force under contract No. AF 33 
(038)-12782 monitored by the Human Resources 
Research Institute, Maxwell Air Force Base, Ala- 
bama. Permission is granted for reproduction, trans- 
lation, publication and disposal in whole or in part 
by or for the United States Government. Personal 
views or opinions expressed or implied are not to be 
construed as necessarily carrying the official sanction 
of the Department of the Air Force. The research 
was conducted through the Laboratory of Social Re- 
lations, Harvard University. A portion of the data 
utilized was derived from a dissertation submitted by 
the senior author in partial fulfillment of the re- 
quirements for the Ph.D. degree at the University of 
Florida. We are grateful to the HRRI staff which 
assisted in various stages of this research. 
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is determined in the limit of the approach by 
the items which are included in the matrix, 
and the subsections of a population which are 
included. 

Wittenborn (12) has indicated the rele- 
vance of a validation study with discrete Ror 
schach scoring variables, and Wittenborn and 
Holzberg (13) have presented the comple- 
mentary argument for using discrete de 
scriptive or behavioral criteria of validation 
Essentially, the point is that unless some com- 
mon variance is found between discrete scor- 
ing categories and discrete descriptive or be 
havioral criteria, there can be little optimism 
for the diagnostic use of the scoring cate- 
gories involved. Wittenborn and Holzberg 
(13) found rather discouraging results in re- 
lating Rorschach scoring categories to symp 
tom manifestations in descriptive diagnosis. 

Validation of a diagnostic tool should be in 
terms of the kinds of uses to which it is put. 
In this study we are interested only in certain 
aspects of scoring which are defined in terms 
of the responses of the subject rather than 
the general impression or evaluation of the 
interviewer. The use of the Rorschach as a 
medium ‘of clinical interview is to be distin- 
guished from its use as a diagnostic tool in 
itself. That is, the Rorschach is a medium of 
clinical interview when it is used to establish 
rapport to observe the behavior of the subject 
or to evoke otherwise pertinent information 
which might be awkward to elicit in a formal 
interview. We are not interested in the char- 
acteristics which are most closely associated 
with the sensitivity and intuitive ability of the 
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interviewer, but with the scores which are 
most arbitrarily defined and reproducible. 


Procedure 


Studies which measure the difference of 
means of selected Rorschach scores among 
extreme subsections of the population may 
prove significant. The information may, how- 
ever, be of little value for prediction. That is, 
since two special cells are compared, or one 
special cell is compared to the remainder of 
the population, it may be that estimates of 
the amount of variance actually under con- 
trol will indicate that the relationship is too 
weak to be practically useful. In this study 
we are interested in measuring the relation- 
ship of Rorschach scores and behavioral de- 
scriptions which exist in a relatively broad 
population. 

Subjects. Our sample consisted of 125 os- 
tensibly normal male Air Force enlisted per- 
sonnel representing the seven enlisted grades. 
The subjects were normally distributed on the 
SRA Test of Primary Mental Abilities, had 
an average age of 27 years with a range from 
20 to 45 years, and were also heterogeneous 
in regard to education and military occupa- 
tion. The only apparent nonnormal charac- 
teristic of this population was that a majority 
of the 18 Basic Airmen had recently been in- 
carcerated for breaches in discipline and had 
lost whatever military grade they had. 

Rorschach scoring categories. Since the fre- 
quency in some of the commonly used Ror- 
schach scoring categories is extremely small, 
and the scores are discrete and unitary, these 
scoring categories cannot properly be utilized 
in testing relationships among persons. That 
is, the units of scoring in these categories are 
too large for the population to be distributed 
according to ordinary correlational require- 
ments. Split-half reliability of this type of 
item will almost invariably be negative as a 
function of the distribution of the scores. For 
this reason, we have taken scores by the fre- 
quency of occurrence without regard to small- 
est detail specification, e.g., we take C to 
mean the sum of all cases in which color oc- 
curs, such as C, CF, FC, FCV, etc. Our scor- 
ing categories in this study are: number of 
responses (R); F +/(F +) + (F —); total 
color responses (C); total motion (/); total 
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vista (V); total shading plus texture (T + 
Y); total space (S$); total large detail (D); 
total rare detail (Dd); popular responses 
(P); organization (Z); content variety; ani- 
mal plus animal detail (A + Ad); anatomy 
(An), total whole (W). 

Criteria. We have taken the fifteen scoring 
categories outlined above and have explored 
their relationship with five groups of variables 
selected as valid criteria: (a) scores of per- 
formance in interaction; (6) ratings by su- 
periors; (c) primary mental ability scores; 
(d) sociometric status indices; and (e), back- 
ground information. 

The scores of performance in interaction 
were taken in a “small group” experiment 
which is reported elsewhere (4). The scores 
represent the average number of acts of the 
person in four sessions which involve getting 
acquainted, planning role-playing sessions, and 
free discussion. In each session, the person 
participated with two different persons. The 
interaction observed in each session was for a 
period of 24 minutes, and represented parts 
of the session in which the subjects were pre- 
sumably unaware of being observed. The cate- 
gories of scoring used were those of interac- 
tion process analysis (1), which have been 
used extensively for behavioral description of 
group and individual performance in discus- 
sion and problem-solving groups. Here we in- 
clude the initiated behavior in the twelve basic 
scoring categories, four subdivisions of the 
twelve categories, and the total. 

Briefly, the categories of this observation 
system may be identified as follows: cate- 
gories 1, 2, and 3, showing solidarity, tension 
release, and agreement; categories 4, 5, and 
6, giving suggestion, opinion, and orientation; 
categories 7, 8, 9, asking for orientation, opin- 
ion, and suggestion; and categories 10, 11, 
and 12, showing disagreement, tension, and 
antagonism. The first three and last three 
categories are known as the positive and nega- 
tive social enivtional categories, respectively. 
The central six categories are known as the 
task categories. 

The ratings by superiors were made by the 
highest ranking commissioned officers having 
direct or effective contact with the airmen. 
The ratings were in terms of performance 
variables judged particularly important in the 
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military context: ability to understand the 
situation and take necessary initiative; ability 
to handle men and make himself understood 
by his men; knowledge of the technical as- 
pects of his job; personal conduct and bear- 
ing; and general over-all rating. 

The scores of primary abilities included are 
those from the SRA Primary Mental Abili- 
ties: verbal meaning, space, reasoning, num- 
ber, word fluency, and a total quotient. 

The affective sociometric indices are: pro- 
pensity to be a chooser, propensity to expect 
to be chosen, choices received (popularity), 
expectancy of others that one will be a 
chooser. These were based on a criterion of 
enjoyment of participation in the session com- 
pleted. Two other indices on a criterion of 
amount done to determine the way the ses- 
sion went are also included: chosen as a 
leader, and chooses self as a leader. 

The background information includes age, 
educational level, and the subject’s military 
grade. 


Method of Analysis 


The method of analysis was governed by 
experience in the search of empirical hypothe- 
ses concerning Rorschach variables.” The first 
question concerned the relationship of R, the 
number of responses, to the criteria. The sec- 
ond question concerned the relationship of 
the other Rorschach variables to the criteria. 
However, since we were primarily interested 
in the relationships of the other variables not 
attributable to the number of responses, our 
matrix was one of partial correlations (Table 
1). We were further interested in whether the 
correlations tend to be ordered properly in 
regard to behavioral hypotheses which are 
phrased according to the criteria included. 
Even if the degree of relationship involved is 
low, the proper ordering of relationships ac- 
cording to hypotheses would indicate the 
feasibility of a multiple regression (configura- 
tional) approach. Thus we stated forty-four 
hypotheses. The hypotheses were then tested 


2 Generalizations of relationship of Rorschach 
scoring categories to personality characteristics have 
been compiled from the five sources (2, 3, 7, 8, 9) 
listed in the references. These generalizations have 
been published separately (5). The generalizations 
taken for hypothesis test here are those considered 
most clearly stated in relatively systematic texts. 


on the basis of the expected coefficient signs 
of the relationships of the Rorschach scoring 
categories with the multiple criteria. 

Our definitions of variables for the tests of 
hypotheses were established before examina- 
tion of the data.* We do not have space for 
justification of the behavioral criteria, which 
do not have obvious face validity in all cases. 


Testing the Hypotheses 


In the tests of hypotheses, for economy in 
presentation, we provide the information in 
Table 2 in the following order: (a) The hy- 
pothesis is stated. (5) At least one source of 
the statement is indicated. (c) The identifi- 
cation of the variable(s) in Table 1 to which 
the Rorschach variable is to be compared is 
stated. (d) The expected sign of correlation 
under hypothesis is indicated. (e) The actual 
sign of the correlation in Table 1 is given. 
(f) Hypotheses are judged as: rejected (sig- 
nificantly in the wrong direction); in the 
wrong direction; in the right direction; not 
rejected (significantly in the right direction). 
Where two or more possible tests are avail- 
able, they are given consecutively. For the 
two-tailed test with .05 level, absolute r = 
.174 is significant (italicized in Table 1), 
which is equivalent to the .025 in hypothesis 
testing. 


Summary and Interpretation 


Of five hypotheses examined concerning the 
meaning of the total number of Rorschach 
responses, one was definitely not rejected and 
the other four were ordered in the right di- 
rection. 

Of thirty-nine hypotheses other than those 
concerning the total number of Rorschach re- 
sponses, with forty-four possible tests, there 
were: two nonrejection, twenty-one ordered 
in the right direction, twenty ordered in the 
wrong direction, and one rejection. 

If hypotheses concerning intelligence only 
are considered, there are (including total R): 
three nonrejections, four in the right direc- 
tion, and two in the wrong direction. 

While it is interesting to consider statements 
concerning the need for “configurational” in- 

8 We are extremely grateful to Robert F. Bales for 


his help in choosing the interaction behavioral cri- 
teria. 
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Testing Behavior Hypotheses with the Rorschach 


Table 2 
Sign Test of Hypotheses 








Hypothesis 


Expected 


signs 





intelligence 


. High Ris associated with compul- 


siveness, drive for thoroughness 


. Subjects in good humor tend to 


have a high R 


. Sullen and unobliging subjects 


tend to have low R 


. High R is associated with manic 


conditions (depression hypothe- 
sis is conceived as identical here) 


. High W is associated with high 


intelligence 


. High W is associated with self- 


assertiveness 


. High W is associated with com- 


pulsiveness 


. High W is associated with manic 


conditions 


Low W is associated with anxiety 
High W is associated with “over- 
all thinking” (abstract ideas and 
major issues) 


. High D is associated with com- 


mon sense or practicality 


. High D is associated with de- 


pression 


. High Dd is associated with low 


intelligence 


. High Dd is associated with com- 


pulsiveness 

High Dd is associated with nag- 
ging and fault finding 

High Dd is associated with low 
adaptability 

High S is associated with oppo- 
sitional behavior 


. Low S is associated with pas- 


sivity 

Total Z varies directly with in- 
telligence 

High Z is associated with elation 
High F+ percentage is associ- 
ated with attention to task and 
ability to concentrate 

High F+ percentage is associ- 
ated with depression 

Low F+ percentage is associ- 
ated with elation 


- High F+ percentage is associ- 


ated with intelligence 


Source Criteria 
2, p. 53; 7, f; g; h; i; 
p. 208 j;k 
3, p. 72 Bg, ee 
9, p. 21 Vv 
9, p. 21 dd, ee 
9, p. 21 hh, gg 
3, p. 20;2, f; g; h; i; 
p. 10 j;k 
9, p. 59 gg 
m 
7, p. 245 ee, gg 
2, p. 13; 9, hh, gg 
p- 40; 3, 
p. 23 
3, p. 23 ee 
2, p. 14; 8, x, y 
p. 57 h 
8, p. 58; 7, a, b 
p. 261; 2 
p. 14 
2, p. 15 bh, gg 
3, p. 28 f; g; h; i; 
i;k 
2, p. 14 ee, gg 
3, p. 28 ff, x 
dd 
3, p. 27 a, b 
2, p. 47; 7, dd, ff 
p. 266; 8, 
p. #0 
2, p. 47 w, ee 
2, p. 12 f; g; h; i; 
j;k 
2, p. 13 Vv 
9, p. 56 x 
2, p. 19 hh, gg 
2, p. 19 Vv 
2, p. 19; 3, f; g; h; i; 
p. 35, 37 j;k 


Actual 
signs 
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Judgment 
nat rejected 
in right direction 
in right direction 


in right direction 


in right direction 


in right direction 
in right direction 
in right direction 
in wrong direction 
in right direction 
in right direction 
in right direction 


in right direction 


in wrong direction 


in right direction 
not rejec ted 

in wrong direction 
in wrong direction 
in wrong direction 


in right direction 


in wrong direction 


in wrong direction 
not rejected 

in wrong direction 
in wrong direction 
in right direction 
in right direction 


in right direction 
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Hypothesis Source 
26. High M is associated with high 9, p. 26; 7, 
intelligence p. 268; 2, 
p. 23 
27. Low M is associated with de- 9, p. 27 
pression 
28. High M is associated with elation 9, p. 27 
29. High color is associated with allo- 2, p. 31 
centricity and awareness of en- 
vironment 
30. High color is associated with ex 9, p. 98 
citability 
31. High color is associated with 2, p. 31 
energy and initiative (with which 
subject attacks problems) 
32. High color is associated with 9, p. 76 
high affectivity 
33. Low color is associated with de- 2, p. 3S; F, 
pression p. Sis 3, 
p. 45 
34. High shading is associated with 2, p. 35, 36 
depression 
35. High shading is associated with 2, p. 35 
passivity 
36. High shading is associated with 3, p. 51 
anxiety 
37. High vista is associated with the 2, p. 33; 9, 
feeling of inferiority p. 201 
38. High vista is associated with de 2, p. 34; 9, 
pression p. 201 
39. Animal form is inversely related 2, p. 15 
with intelligence 
40. High animal response is associ- 8, p. 80 


ated with childhood 
41. High anatomy responses are as- 


i) 
-. = 
w 


sociated with hypochondriasis p. 63, 64 
42. High variety of content is related 7, p. 272; 
to high intelligence and high edu 2, p. 41 
cation 
43. High variety of content is related 7, p. 272 
to high education 2,p.41,42 
44. Low number of popular responses 2, p. 17 


is associated with low intelligence 


terpretation of protocols, these results indicate 
that if the generalizations implicit or explicit 
in the Rorschach theory are jointly consid- 
ered, except in the case of total R, the inter- 
preter will be on quite tenuous ground. The 
ordering of relationships between the Ror- 
schach variables and the criteria is not dis- 
similar from chance expectation. Further, not 
oniy are most of the relationships of zero or- 
der, but the only ones in which this is not the 
case involve intelligence, which can be ap- 


Table 2—Continued 


Expected Actual 
Criteria signs signs Judgment 
f; #- hs is + + in right direction 
j,k 
hh, gg 14 + — in wrong direction 
Vv } + in right direction 
bb, cc, x ae oe oo S oie a oa in right direction 
ee, ff {- -$- a in wrong direction 
x } + in right direction 
a $ - in wrong direction 
l “+ in right direction 
hh, kk + coe in wrong direction 
hh, gg t+ —+ in wrong direction 
hh, gg ~ ++ rejected 
w, ee + + - in wrong direction 
v, ee bo + — in wrong direction 
ee + -+- in right direction 
hh, gg ion top in wrong direction 
f; g; h;i; -- +? in wrong direction 
j;k 
r - -- in right direction 
ee + - in wrong direction 
f; g; h; i; + —? in wrong direction 
j; k (but word fluency 
significant) 
s + + in right direction 
f; g; h;i t + in right direction 
j;k 


proached more efficiently by other instru- 
ments. 

The implications of findings of this order 
are twofold: (a) While one might question 
the validity of the criteria, the questioner 
needs to provide better criteria to demonstrate 
the relationships exist in fact. Pointing to the 
significant differences found in carefully pre- 
classified groups is not a demonstration of the 
validity of the measure. It does not constitute 
forward selection or prediction. Equally im- 
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Testing Behavior Hypotheses with the Rorschach 


portant for consideration is that the preselec- 
tion criteria may be easier to apply than the 
test; extreme behavior may be recognized by 
other tools (including even direct questions). 
(6) The matrix of intercorrelations indicates 
that, although the amount of variance under 
control in any given instance is small, for lim- 
ited purposes a forward validation study of 
the Rorschach may indicate utility of some of 
the arbitrary scoring categories in use. 


Received Sepiember 8, 
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Predicting Success on the Member-Employee 
Rehabilitation Program’ 


Bernard A. Stotsky 
VA Hospital, Brockton, Massachusetts 


To aid in rehabilitating chronic hospital- 
ized psychotics, the Member-Employee pro- 
gram was instituted in VA-NP hospitals. Se- 
lected patients were discharged and placed in 
full-time salaried positions as employees of 
the hospital. Employment in a normal work 
atmosphere was designed to help them make 
the transition from hospital to community 
more easily. Selection of member-employees 
by the Medical Rehabilitation Board was 
mainly on an intuitive basis. 

This study was undertaken to discover ob- 
jective criteria which could be used to pre- 
dict success on the program. The Guilford- 
Zimmerman, Manson, Revised Beta, Purdue 
Pegboard tests, patient attitude, Palo Alto 
Hospital Adjustment, Northport rating scales, 


1An extended report of this study may be ob- 
tained without charge from Bernard A. Stotsky, 
1233 Warren Ave., Brockton, Massachusetts, or for 
a fee from the American Documentation Institute. 
To obtain it from the latter source, order Docu- 
ment No. 4555 from ADI Auxiliary Publications 
Project, Photoduplication Service, Library of Con- 
gress, Washington 25, D. C., remitting in advance 
$1.75 for microfilm or $2.50 for photocopies. Make 
checks payable to Chief, Photoduplication Service, 
Library of Congress. 


and information on seven biographical items 
were collected for the first 18 patients ap- 
proved by the board. Of all the tests, scales, 
and items used, only three of the biographi- 
cal items—arrests for any except psychiatric 
reasons, difficulty with alcohol prior to the 
past two years, and present difficulties with 
alcohol—daifferentiated the successful from the 
unsuccessful member-employees. With the 
sample increased to 36, differences for the 
three items were significant at .05 level. The 
item, present difficulties with alcohol classi- 
fied 35 out of 36 correctly, being significantly 
related to failure (p < .001). Only this item 
predicted significantly better than the board 
(p = .02). For a second sample of 25 from 
another VA hospital, the item did not dis- 
criminate better than chance though the trend 
was positive (p = .11). 

Two main reasons for failure on the pro- 
gram were exacerbation of psychotic symp- 
toms and overindulgence in alcohol. From 
these findings it appears that alcoholics and 
incompletely stabilized psychotics are poor 
prospects for a program of this type. 

Brief Report 
Received March 9, 1955. 
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Relations Among Several Objective Measures of 
Anxiety Under Different Conditions of Motivation’ 


Anthony Davids 


Harvard University 


Psychologists have long agreed that the 
problem of human anxiety is of great theo- 
retical and practical significance, but it seems 
to have taken the development of a rather 
simple questionnaire to open the floodgates 
and release a tidal wave of experimental find- 
ings. We will not even attempt to review the 
host of publications that have appeared on 
the psychological scene since Taylor recently 
reported on her scale for measuring manifest 
anxiety (18, 19). Performance on this scale 
has been related to a wide variety of experi- 
mental measures, including such things as 
eyelid conditioning (9, 16, 17, 18), verbal 
learning (11, 15, 20), word associations (3), 
reactions to stress (4, 22), responses to pro- 
jective tests (8, 22), and various other com- 
plex behaviors (1, 7, 14, 21). Also, a compre- 
hensive review of these studies and a great 
many others has been prepared (13). So, 
rather than discuss studies that are probably 
familiar to anyone acquainted with the recent 
literature, we will turn immediately to con- 
sideration of the present experiment. 

In the attempt to discover what unique ad- 
vantages or disadvantages this new anxiety 
inventory might have, results were compared 
on the following instruments: (a) Taylor 


1 This study, conducted at the Harvard Psycho- 
logical Clinic as part of a program of research un- 
der the direction of Professor Henry A. Murray, was 
facilitated by the Laboratory of Social Relations. 
The research project was supported in part by a 
grant from the Rockefeller Foundation, and by grant 
M-700 from the National Institute of Mental Health, 
Public Health Service. The author gratefully ac- 
knowledges the assistance of Mr. Leo McNamara, 
who helped with the scoring and statistical analysis 
of the data. 
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anxiety scale; (6) Psycho-somatic Inventory; 
and (c) anxiety self-ratings. 

More specifically, there were two main pur- 
poses in this study. First, we wished to ex- 
amine the intercorrelations between results on 
the different measures within each of two 
groups of subjects. Second, we wished to see 
what effect the experimental manipulation of 
motivation would have on responses to the 
various objective measures of anxiety. 


Method 


Subjects. There were two experimental 
groups, each consisting of 20 male under- 
graduates selected from an introductory psy- 
chology course. With the exception of the 
experimental manipulation of motivation, de- 
scribed below, the procedure for selecting 
members of both groups was designed to con- 
trol as many relevant variables as possible. 
The groups were matched to the extent where 
we felt quite certain that any differences re- 
vealed on the experimental measures could 
probably be attributed to the different condi- 
tions of motivation under which they were 
examined. 

Treatments. The first group of 20 Ss com- 
pleted the questionnaire and self-ratings in 
the course of their service as paid volunteers 
participating in an intensive investigation of 
personality. They believed that the results 
were anonymous, and were informed that the 
data would be used solely for purposes of 
“scientific research” and would not affect 
them personally in any way. The second 
group of 20 Ss was comparable to the first, 
with the exception that they were informed 
the results would be used to select one or 
two members from the group to work as 
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highly paid assistants to staff members con- 
ducting research on small group interaction. 
They were led to believe that we were look- 
ing for mature, well-adjusted individuals who 
would be able to observe and analyze the be- 
havior of others with minimal interference 
from their own problems and abnormalities. 
At the time of selection, an interview was con- 
ducted with each S in order to ensure that 
only individuals with high motivation to se- 
cure the position would be used in the pres- 
ent study. 

Measures. The Taylor scale (19) consists 
of 50 items selected from the Minnesota 
Multiphasic Personality Inventory (MMPI) 
on the basis of clinical judgment that the 
items are indicative of manifest anxiety. These 
statements, to which S answers either “true” 
or “false,” are embedded in a Biographical 
Inventory which contains 175 additional 
buffer items that were also taken from the 
MMPI. The maximum possible anxiety score 
is 50 and the minimum is zero. 

The Psycho-somatic Inventory (12) con- 
sists of 92 questions, of which 46 refer to 
psychological experiences and 46 refer to 
physiological experiences. These experiences 
are supposed to differentiate the “psychoneu- 
rotic”’ from the “normal” individual. The 
questions are answered on a 4-point scale 
running from “often” to “never,” and the 
total score based on the entire inventory 
provides a measure of “neuroticism.” High 
positive scores are indicative of normality 
and negative scores are indicative of neu- 
roticism. 

The anxiety self-rating scale (2) consists 
of five parts. There are four subratings in re- 


Table 1 


Rank-Order Correlations Among Three Measures 
of Anxiety Under Two Conditions 
of Motivation * 











Taylor Psycho-somatic 
Measure anxiety scale Inventory 
Anxiety self-ratings .60** .74 74 84 
Taylor anxiety scale 76 83 





* Italicized coefficients are for the 20 “research volunteers” 
and nonitalicized coefficients are for the 20 “job seekers.” 
A coefficient of .52 is significant at the .01 level for a one- 
tailed test. 


sponse to specifically defined experiences and 
feelings indicative of anxiety, and one general 
rating. The four subratings are concerned 
with (a) illness, (0) irrational fears, (c) in- 
security, and (d) anxiety symptoms. For each 
subarea several examples are provided in or- 
der to leave little doubt as to the kinds of 
thoughts and behaviors being assessed. The 
general rating follows the four subratings, and 
the instructions read: “Comparing yourself 
with others of the same sex and age, rate 
your usual level of general anxiety by placing 
a cross on the appropriate point on the fol- 
lowing scale.” Each of the five separate rat- 
ings is made on a 6-point scale, running from 
“much less than most people,” to “much more 
than most people.” Summing scores for the 
five ratings, the maximum anxiety score ob- 
tainable is 30 and the minimum is 5. 

Predictions. Our expectation was that there 
would be a significant positive association be- 
tween the different measures of anxiety within 
each group, and that there would be less anx- 
iety evidenced by the ‘job seekers” than by 
the “helpers of science.” 


Results and Discussion 


The results presented in Table 1 show that 
within both groups there are significant inter- 
correlations among the three different meas- 
ures of anxiety. In both groups, the correla- 
tion between the manifest anxiety scale and 
the Psycho-somatic Inventory is not much 
lower in magnitude than reliability coeffi- 
cients reported for the manifest anxiety scale 
(19). These results indicate that the Taylor 
scale is not unique. Regardless of the par- 
ticular instrument employed to assess anx- 
iety, the relative standing of the Ss is quite 
similar. 

Comparing the mean anxiety scores for the 
two groups, it is evident from Table 2 that Ss 
who are motivated to present a favorable pic- 
ture of themselves reveal less anxiety in re- 
sponse to each of the three assessment meth- 
ods. Rather unexpectedly, it is the self-rating 
scales that show the least difference between 
the two groups. In response to the Psycho- 
somatic Inventory, members of the group with 
nothing to gain by deceiving us reveal them- 
selves as more neurotic. That is, they admit 
having more experience with disturbing anx- 
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Relations Among Measures of Anxiety 


Table 2 


Comparison of Anxiety Scores for Two Groups of 20 Ss 








“Research volunteers”’ 





“Job seekers” 





Measure Mean Variance Mean Variance I t 
Anxiety self-ratings 15.6 36.1 15.0 36.7 1.00 29 
Psycho-somatic Inventory 137.7 25730.9 202.2 10902.4 2.36* 1.50 
Taylor anxiety scale 20.8 64.3 13.8 46.6 1.38 2.96** 





* Significant at the .05 level. 
** Significant at the .01 level. 


iety (lower scores indicate greater disturb- 
ance) than do the Ss who are motivated to 
appear “well adjusted.” The difference be- 
tween these means does not attain the .05 
level of significance, but Bartlett’s test re- 
veals that the variance for the group of volun- 
teer research Ss is significantly greater, which 
is what we would expect in a group that is 
not motivated to distort their responses in 
the direction of social acceptability. 

Although the above differences are in ac- 
cord with our theoretical predictions, it is 
only the manifest anxiety scale that shows a 
statistically significant difference between the 
means for the two groups. This difference of 
seven points, with the highly motivated Ss 
showing less manifest anxiety, is significant 
beyond the .01 level, indicating that, in the 
present study, the Taylor scale is especially 
susceptible to Ss’ conscious or unconscious 
motivation to present a favorable picture of 
themselves. This finding receives additional 
confirmation from the fact that seven Ss in 
the group of “job seekers” received manifest 
anxiety scores that were lower than the score 
of 10 achieved by the lowest-ranking S in the 
group of “research volunteers.” 

At this point, let us consider briefly the 
high degree of consistency among findings de- 
rived from different measures of anxiety. This 
is no isolated finding for several previous in- 
vestigators have also found significant rela- 
tions between anxiety measured by the Taylor 
scale and anxiety measured by other objec- 
tive instruments. Holtzman, Calvin, and Bit- 
terman (10) correlated Taylor anxiety scores 
with neuroticism measured by the Winne scale 
(23), and found a coefficient of .74. When the 
correlation was corrected for attenuation due 

to the unreliability of each scale, it increased 


to .86. These scales represent independent 
adaptations from the MMPI, and contain 7 
overlapping items, but, nevertheless, the mag- 
nitude of this relationship is quite high. In 
another study, Deese, Lazarus, and Keenan 
(4) found a correlation of .69 between the 
Taylor scale and Winne scale. 

The psychasthenia scale from the MMPI 
has also been found to relate positively to the 
Taylor scale. Deese, Lazarus, and Keenan 
(4) obtained a correlation of .81 between 
these scales, and a correlation of .40 after 
overlapping items had been eliminated. Erik- 
sen (5) reported a correlation of .72 between 
these same scales. And Eriksen and Davids 
(6) secured a correlation of .92 between psy- 
chasthenia and manifest anxiety. This latter 
finding was reduced only slightly, to .86, 
when 8 overlapping items were excluded. 

These results, coupled with findings in the 
present study, indicate that performance on 
the Taylor scale of manifest anxiety is highly 
related to (a) self-ratings on anxiety; (5) 
neuroticism on the Psycho-somatic Inventory; 
(c) neuroticism on the Winne scale; and (d) 
psychasthenia on the MMPI. In many in- 
stances, the magnitude of relationship be- 
tween the independent scales is about as high 
as reliability coefficients for the Taylor scale. 
Thus, several seemingly diverse researches 
seem likely to be investigating very similar, 
if not identical, phenomena. It may be, as 
Eriksen and Davids suggest (6), that the 
Taylor scale is not so much a measure of 
amount of anxiety as it is a measure of the 
way people respond to or cope with their 
anxiety. At any rate, these consistent findings 
from independent investigations, relating re- 
sults on the different objective measures to 
performance in a variety of psychological ex- 
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periments, suggest that these several lines of 
research should be brought together and 
viewed in some common framework. 

In conclusion, we would like to point out 
that the Taylor scale is only one of many 
available objective techniques for assessing 
anxiety. And it may well be that other in- 
struments, some of which have been estab- 
lished for years, provide even more valid 
measures of anxiety than does the Taylor 
scale. Evaluated according to the criterion of 
generating research, there is no doubt that 
this scale has made a notable contribution. 
Yet the reason why psychologists have seized 
upon this instrument with such eagerness is 
not easy to understand. In fact, one could 
ask, legitimately, “Why the emphasis on the 
Taylor scale?” An attempt to answer this 
question is beyond the scope of this paper. 
Here, we wish merely to stress the point that 
any one of several objective instruments could 
probably be employed with equal fruitful- 
ness in the selection and classification of Ss 
for investigations of anxiety and behavior. 

One thing, at least, seems certain. When ob- 
jective measures are employed, and responses 
accepted at face value, the condition under 
which the Ss are examined is of considerable 
importance. When the examinees have some- 
thing to gain by reporting fewer experiences 
with disturbing anxiety, these objective meas- 
ures are quite susceptible to distortion. Re- 
sults of the present experiment suggest that 
the Taylor scale may be even more susceptible 
to deception than are other objective meth- 
ods for assessing anxiety. 


Summary 


Two groups of male undergraduates were 
administered the Taylor anxiety scale, Psy- 
cho-somatic Inventory, and anxiety self-rat- 
ing scale. One group of 20 Ss took these 
procedures as volunteers participating in a 
research project, with anonymity guaranteed. 
The second group of 20 Ss was informed that 
the results of the test battery would be em- 
ployed to select a few “mature, well-adjusted” 
individuals to work as paid assistants con- 
ducting psychological experiments. 

In both groups highly significant intercor- 
relations were found among the three objec- 


tive measures of anxiety. When the groups 
were compared, it was found that on the 
three measures the group of “research volun- 
teers’ achieved scores more indicative of 
manifest anxiety and maladjustment than did 
the group of “job seekers.” Although these 
results were all in keeping with our theoreti- 
cal expectations, it was only on the scale of 
manifest anxiety that the difference between 
the two groups attained the .01 level of sta- 
tistical significance. 

It was concluded that (a) the Taylor anx- 
iety scale measures essentially the same vari- 
able or trait as that measured by several other 
available instruments, (6) the Taylor anxiety 
scale may be more susceptible to deception 
than are some of these other instruments, and 
(c) a number of seemingly heterogeneous re- 
searches may actually bear upon common 
phenomena. 


Received November 4, 1954. 


References 


1. Bitterman, M. E., & Kniffin, C. W. Manifest anx- 
iety and “perceptual defense.” J. abnorm. soc. 
Psychol., 1953. 48, 248-252. 

2. Davids, A. The influence of personality on audi- 
tory apperception and memory. Unpublished 
doctor’s dissertation, Harvard Univer., 1953. 

3. Davids, A., & Eriksen, C. W. The relation of 
manifest anxiety to association productivity 
and intellectual attainment. J. consult. Psy- 
chol., 1955, 19, 219-222. 

4. Deese, J., Lazarus, R. S., & Keenan, J. Anxiety, 
anxiety reduction, and stress in learning. J. 
exp. Psychol., 1953, 46, 55-60. 

. Eriksen, C. W. Some personality correlates of 
stimulus generalization under stress. J. ab- 
norm. soc. Psychol., 1954, 49, 561-565. 

6. Eriksen, C. W., & Davids, A. The meaning and 
clinical validity of the Taylor anxiety scale 
and the hysteria-psychasthenia scales from the 
MMPI. J. abnorm. soc. Psychol., 1955, 50, 
135-137. 

7. Farber, J. E., & Spence, K. W. Complex learning 
and conditioning as a function of anxiety. J. 
exp. Psychol., 1953, 45, 120-125. 

8. Goodstein, L. D. Interrelationships among sev- 
eral measures of anxiety and hostility. J. con- 
sult. Psychol., 1954, 18, 35-39. 

9. Hilgard, E. R., Jones, L. V., & Kaplan, S. J. 
Conditioned discrimination as related to anx- 
iety. J. exp. Psychol., 1951, 42, 94~-99. 

10. Holtzman, W. H., Calvin, A. D., & Bitterman, 
M. E. New evidence for the validity of Tay- 
lor’s manifest anxiety scale. J. abnorm. soc. 
Psychol., 1952, 47, 853-854. 


am 





ro 





Ta ee 








ly 








il. 





Relations Among Measures of Anxiety 279 


Lucas, J. D. The interactive effects of anxiety, 
failure, and intraserial duplication. Amer J. 
Psychol., 1952, 65, 54-66. 


. McFarland, R. A., & Seitz, C. P. A psycho- 


somatic inventory. J. appl. Psychol., 1938, 22, 
327-329. 


3, Mandler, G. Anxiety and performance: empirical 


and theoretical aspects of anxiety scales. Un- 
published manuscript. Laboratory of Social 
Relations, Harvard Univer., 1954. 


. Matarazzo, J. D., Ulett, G. S., & Saslow, G. Hu- 


man maze performance as a function of in- 
creasing levels of anxiety. J. gen. Psychol, 
in press. 


. Montague, E. K. Role of anxiety in serial rote 


learning. J. exp. Psychol., 1953, 45, 91-96. 


. Spence, K. W., & Farber, J. E. Conditioning and 


extinction as a function of anxiety. J. exp. 
Psychol., 1953, 45, 116-119. 


7. Spence, K. W., & Taylor, Janet A. Anxiety and 


strength of the UCS as determiners of the 


19. 


amount of eyelid conditioning. J. exp. Psy- 
chol., 1951, 42, 183-188. 


. Taylor, Janet A. The relationship of anxiety to 


the conditioned eyelid response. J. exp. Psy- 
chol., 1951, 41, 91-92. 

Taylor, Janet A. A personality scale of manifest 
anxiety. J. abnorm. soc. Psychol., 1953, 48, 
285-290. 


. Taylor, Janet A., & Spence, K. W. The relation- 


ship of anxiety level to performance in serial 
learning. J. exp. Psychol., 1952, 44, 61-66. 


. Wesley, Elizabeth L. Perseverative behavior in a 


concept-formation task as a function of mani- 
fest anxiety and rigidity. J. abnorm 


soc. Psy- 
chol., 1953, 48, 129-134. 


. Westrope, Martha R. Relations among Rorschach 


indices, manifest anxiety, and performance un- 
der stress. J. abnorm. soc. Psychol., 1953, 48, 
515-524. 


. Winne, J. F. A scale of neuroticism: an adaption 


of the Minnesota Multiphasic Personality In- 


ventory. J. clin. Psychol., 1951, 7, 117-122. 





Journal of Consulting Psychology 
Vol. 19, No. 4, 1955 


A Further Investigation of the Relationship Between 
Manifest Anxiety and Intelligence 


Allen D. Calvin, Paul B. Koons, Jr., Joseph L. Bingham, 
and Howard H. Fink 


Michigan State University 


Grice (2), who worked with airman basic 
trainees, recently reported a significant nega- 
tive relationship between Air Force Clerical 
Aptitude Index scores (which he states may 
be regarded as a general intellectual meas- 
ure) and performance on the Taylor Mani- 
fest Anxiety Scale (A scale). Kerrick (3), 
who also worked with Air Force trainees, re- 
ported that the A scale correlates negatively 
with a number of Air Force tests of intel- 
lectual abilities. Matarazzo et al. (4) used 
college students as Ss and failed to find a sig- 
nificant relationship between A-scale scores 
and performance on the CVS; however, they 
did find a significant negative correlation be- 
tween A-scale scores and the ACE. Schulz 
and Calvin (5) failed in their attempt to 
replicate Matarazzo et al.’s finding of a sig- 
nificant negative relationship between A-scale 
scores and the ACE. Farber and Spence, who 
have made the most extensive contributions 
to the A-scale literature, state: “The authors 
have, in fact, been unable, over a period of 
years, to find any relation between A-scale 
scores of college students and conventional 
measures of intellectual ability, such as en- 
trance-examination scores and grade-point av- 
erages” (1, p. 10). 

Because of the widespread use of the A 
scale as a research and clinical instrument, 
a resolution of these contradictory findings 
seems called for. The present experiment in- 
vestigates some of the factors leading to the 
equivocal results obtained in earlier studies. 


Method 


Subjects. The Ss were obtained from two 
separate sources. The first group, hereafter 


referred to as Group A, were students in an 
undergraduate course in psychology at Michi- 
gan State University. The group consisted of 
36 Ss, 21 males and 15 females. 

The other group, hereafter referred to as 
Group B, was obtained from a how-to-study 
course offered for students who were having 
scholastic difficulty. Two additional Ss for 
this group were selected from a class in ele- 
mentary psychology in which they were ex- 
periencing considerable difficulty with the 
course material. This group had an N of 15, 
12 males and 3 females. 

Procedure. The Wechsler-Bellevue Intelli- 
gence Test (7) was administered in individual 
sessions to each S. The A scale was presented 
with the Biographical Inventory items as sug- 
gested by Taylor (6). 


Results 


The Wechsler scores for Group A ranged 
from 102 to 141 with a mean of 122.75 and 
a o of 9.18. This range, while not unusual for 
college students, is lacking in low scores; 
therefore we decided to obtain additional Ss 
of lower intelligence, and Group B was ob- 
tained (range 92 to 129, mean 108.53, o 
10.41). However in order to obtain Ss with 
such low scores it was necessary to select 
students having trouble with their academic 
work—this being an almost invariable con- 
comitant of such scores in a university popu- 
lation. This, of course, creates some question 
as to the propriety of combining the scores of 
Group B with Group A. We decided to pre- 
sent the data for Group A alone and also to 
present the findings for the two groups com- 
bined. In interpreting the findings for the 
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Table 1 


Pearson r’s between A-Scale Scores and 
Wechsler Performance 











Combined 
groups 
Item Group A Aand B 
Full IQ —.21 —.31* 
Verbal IQ —.22 — .39** 
Performance IQ —.15 —.18 
Information —.11 — 44** 
Comprehension —.19 —.25 
Digit Span —.37* --.31* 
Arithmetic —.19 —.31* 
Similarities — .02 —.14 
Vocabulary 08 — .29* 
Picture Arrangement — .02 13 
Picture Completion — .07 —.19 
Block Design — .36* — 48** 
Object Assembly —.23 —.29* 
Digit Symbol 02 —.11 


* Significant <5% level. 
** Significant <1% level. 


combined groups (range 92 to 141, mean 
118.57, o 11.56), the reader should, of course, 
bear in mind the manner in which Group B 
was selected. 

The results for Group A alone and for the 
combined groups appear in Table 1. The cor- 
relations presented are between A-scale scores 
and the derived IQ scores (prorating for vo- 
cabulary where necessary), and between A- 
scale scores and raw subtest scores. Examin- 
ing the findings for Group A first we see that 
the correlation between total IQ and mani- 
fest anxiety is not significant; however, an 
examination of the subtest correlations re- 
veals significant negative correlations between 
A-scale scores and Digit Span and A-scale 
scores and Block Design.’ 

The results for Groups A and B combined 
indicate a significant negative relationship be- 
tween A-scale scores and Full Scale IQ, Verbal 
IQ, Information, Digit Span, Arithmetic, Vo- 
cabulary, Block Design, and Object Assem- 
bly. Because of the previously mentioned 


1Jt is interesting to note that these subtests have 
been mentioned by numerous clinicians as being 
good anxiety indicators, and some investigators using 
different measures of anxiety have also found these 
subtests able to differentiate anxious Ss. The experi- 
mental findings are far from unequivocal; however, 


space precludes an adequate discussion of this topic 
here. 
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scholastic difficulties of Group B which is 
confounded with their lower IQ scores, it is 
impossible to make any unequivocal ivter- 
pretation of these results. However, these 
findings indicate the necessity of restricting 
the conclusions drawn from a particular ex- 
periment to the population under study and 
the specific measure of intelligence used. 


Discussion 


Although we failed to obtain a significant 
negative relationship between A-scale scores 
and IQ in our “normal” group of students, 
which supports the previous findings of Schulz 
and Calvin (5) and Farber and Spence (1), 
our finding in the “normal” group of a sig- 
nificant negative correlation between A-scale 
scores and several Wechsler subtests, plus the 
highly significant results obtained when the 
students with lower IQ scores (and concomi- 
tant scholastic difficulties) were added, indi- 
cate the necessity for closely examining the 
intellectual make-up of the individuals used 
as Ss in any experiment utilizing the A scale. 
It seems quite possible, as Kerrick (3) sug- 
gests, that the contradictory findings reported 
by various investigators who used the A scale 
to select high and low anxious groups for 
learning experiments, conditioning experi- 
ments, etc. were due to variations in the in- 
tellectual make-up of the respective experi- 
mental populations. 


Summary 


Two groups of college students were given 
the Wechsler-Bellevue Intelligence Test and 
the Taylor Anxiety Scale. Group A was com- 
posed of 36 students in an undergraduate 
psychology class. Group B was made up of 
15 students with lower IQ scores who were 
having academic difficulty. 

Significant negative correlations between A- 


2 Confounding of another type also exists in the 
relationship between anxiety and intelligence. As 
Grice (2) and Kerrick (3) pointed out, it may be 
that the highly anxious S is handicapped on an in- 
telligence test and therefore obtains a lower score 
than his “true” score. 

Our colleague Dr. Charles Hanley suggests another 
possibility. He feels that the Ss of lower intelligence 
may have difficulty understanding the A-scale items 
and may inadvertently check items which raise their 
A-scale scores 








282 A. D. Calvin, P. B. Koons, Jr., J. L. Bingham, and H. H. Fink 


scale scores and several Wechsler subtests 
were reported for Group A, and when Group 
B was combined with Group A the A-scale 
scores of the combined groups showed a sig- 
nificant negative correlation with Total IQ, 
Verbal IQ and a large number of subtests. 
The implications of these results for con- 
temporary research in this area are discussed. 
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The Correlation of Intelligence and Neurological 
Findings on Twenty-Two Patients 
Autopsied for Brain Damage’ 


Robert S. Morrow 
VA Hospital, Bronx, New York 


and Joseph C. Mark * 


VA Hospital, East Orange, New Jersey 


This paper is the first part of a more ex- 
tensive investigation of the effects of various 
types of structural brain pathology on the 
psychological test performance of twenty-two 
adult males. In each of these cases the brain 
pathology was the main cause of death as de- 
termined by autopsy. All of these former pa- 
tients had received a routine battery of psy- 
chological diagnostic tests as well as the 
usual neurological examination and _tech- 
niques, i.e., EEG, laboratory studies, etc. 
The plan of the investigation is to correlate 
the psychological test results with the neuro- 
logical and post-mortem findings. 

The present paper deals solely with the ef- 
fect of structural brain pathology on intel- 


1A modified version of this paper was read at the 
American Psychological Association, New York, Sep- 
tember, 1954. 

2Formerly with the Clinical Psychology Section, 
Neuropsychiatric Service of the Veterans Adminis- 
tration Hospital, Bronx, New York where this work 
was done. The authors wish to express their in- 
debtedness to the following: Dr. Louis Berlin, As- 
sistant Professor of Neurology at Cornell University 
Medical College and former chief of the Bronx VA 
Hospital Neurology Service, for his assistance on the 
problems involving neurology, neuroanatomy, and 
neuropathology; and to the following Bronx VA 
Hospital staff members: Dr. Jacob Cohen, Assistant 
Chief Clinical Psychologist, for his help on the sta- 
tistical evaluations; to Dr. H. L. Flowers, Chief of 
Neuropsychiatry, and Dr. E. G. Kreuger, Chief of 
Neurosurgery, for their cooperation and support, and 
to Dr. Harold G. Wolff, senior consultant in neurol- 
ogy whose searching questions and comments inspired 
this study. 


lectual functioning as measured by the Wech- 
sler-Bellevue Intelligence Scale and specifi- 
cally it will report on: 

1. The relationship between structural brain 
pathology and total as well as subtest Wech- 
sler-Bellevue scale functioning. That is, the 
Wechsler-Bellevue results of this obviously 
brain-damaged group will be analyzed and 
compared with a control group. 

2. Comparing the test scores of those whose 
locus of damage is in the anterior region of 
the brain (pre-Rolandic) with those whose 
lesions are in the posterior regions (post- 
Rolandic). 

3. Comparison between the effects of focal 
and diffuse brain pathology on the intelli- 
gence test. 

4. Comparing the effect of dominant cere- 
bral hemisphere lesions with nondominant 
ones. 


Historical Background of the Problem 


The literature on the relationship between 
brain disturbance and psychological function- 
ing is extensive, even when confined to studies 
of patients rather than animals. Klebanoff 
(17, 18) has written two excellent surveys. 
The recent use of intelligence tests such as 
the Wechsler-Bellevue Intelligence Scale in 
the studies of brain functioning has yielded 
valuable information regarding some of the 
older theories of brain functioning, such as 
localization theories, and has raised new and 
important hypotheses. For the most part, 
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however, the studies using the Wechsler-Belle- 
vue test were concerned with the development 
of test patterns as diagnostic signs as indi- 
cated in the writings of Wechsler (27) and 
Rapaport (21). Allen’s (2, 3, 4) studies are 
typical of this approach. 

The major criticism of these studies has 
been their failure to use adequate control 
groups to permit the comparison of patho- 
logical brain function with the function of 
persons free from structural brain pathology. 
Many studies have been reported on the lo- 
calization of intellectual functions (6, 8, 9, 
10, 12, 13, 14, 19, 20, 22, 23, 25, 26) and 
these have been criticized for failing to use 
specific anatomical data. This study attempts 
to take care of both these important objec- 
tions. 


Subjects and Procedures 


In this investigation, a brain-damaged group 
was compared with a control group of psy- 
chiatric patients. Each group contained 22 
male patients from the Veterans Administra- 
tion Hospital in the Bronx, New York. The 
death and post-mortem examination of the 
brain-damaged patients occurred within the 
past seven years during which time each had 
been referred at least once for psychological 
diagnostic examination from the neurological 
or neurosurgery services. They were routine 
referrals handled by different staff and trainee 
psychologists. Wherever possible each patient 
received Form II of the Wechsler-Bellevue 
Intelligence Scale, the Wechsler Memory 
Scale, the Rorschach, Bender Gestalt, and 
Figure Drawing tests and in certain instances 
special tests (i.e., Goldstein-Scheerer, aphasia 
tests, etc.). 

The psychological, neurological, and post- 
mortem data in this study come from the 
retrospective examination of the permanent 
records of the patients. The psychological 
tests were administered to the brain-damaged 
patients from one week to twenty-five months 
prior to death, the median being seven 
months. The tests were given only when the 
patient was, according to the judgment of 
both neurologist and psychologist, in good 
enough physical and mental condition to be 
tested. 

The same battery of tests was given to the 


control group from the psychiatric wards who 
were matched for age, education, and color. 
The results of this matching as given in 
Table 1 show that both groups were approxi- 
mately 40 years old and had about 10 years 
of formal education. Individual matching for 
occupation was not considered necessary be- 
cause most of our patients come from the un- 
skilled occupational groups. The psychiatric 
patients were either neurotic or mildly schizo- 
phrenic but were not at the time of testing 
receiving any physiological therapy. 

Of the group of 22 brain-damaged patients, 
18 had direct involvement of the cortex; the 
remaining 4 consisted of 2 subtentorial (pos- 
terior fossa) and 2 third-ventricle tumor 
cases. Eleven of the 18 cortical cases were 
considered focal in that the lesion, regardless 
of size, was circumscribed; these were mostly 
tumors. The other 7 were considered diffuse 
in that most or all of the cerebrum was af- 
fected, resulting primarily from vascular, 
toxic, or infectious disease. Of the 18 cortical 
lesions, 4 were anterior (pre-Rolandic), while 
14 were predominantly posterior (post-Ro- 
landic and pre- and post-Rolandic). Also, of 
these 18, 8 were in the left hemisphere, 2 
were in the right hemisphere, and 8 were bi- 
lateral. All patients had a history of right- 
handedness. In making these determinations 
we were assisted by a neurologist who worked 
from the autopsy and neurological reports. 
The autopsy reports contained the micro- 
scopic as well as gross brain examination find- 
ings of the pathologist. 


Results 


The Wechsler-Bellevue intelligence test 
scores for the brain-damaged and psychiatric 
control groups are presented in Table 1. In 
addition, the Wechsler-Bellevue scores for 45 
normal patients were available and are pre- 
sented in the last column for further com- 
parison. These patients, tested as part of an- 
other study which required normal controls, 
were recuperating from minor surgery (i.e., 
appendectomy, tonsillectomy, etc.) and had 
no history of either brain damage or psychi- 
atric difficulty. They could not be used in 
this study as normal controls because they 
had received only the intelligence test and 
also because they were younger than the 














brain-damaged group. The data for this group 
are given for the benefit of those who desire 
some form of normal reference point other 
than the standardized norms. 

As can be seen from Table 1, the brain- 
damaged group is significantly lower in Full 
Scale and Performance IQ, but not signifi- 
cantly lower in Verbal IQ. Most of the sub- 
test scores, with the exception of Vocabulary, 
Information, Comprehension, and Digits For- 
ward, are significantly lower for the brain- 
damaged groups. This is particularly true for 
the performance tasks. The brain-damaged 
patients fared worst on the Digit-Symbol test, 
with an average weighted score of 4.23 and 
four of the subjects making zero weighted 
scores. On the other hand, the Vocabulary 
score of the brain-damaged group was the 
same as the controls, indicating that the vo- 
cabulary function in brain damage was ap- 
parently unimpaired. On the whole, the low 
performance test scores together with low 
Digit Span, Arithmetic, and Similarities cor- 
roborated the psychometric test patterns of 
organic brain pathology as reported in the 
literature. 

Table 2 compares the 11 focal cases with 


Table 1 


Wechsler-Bellevue Intelligence Scale Scores of Brain- 
Damaged and Psychiatric Control Patients 


Mean score 
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— Mean 
Brain- Psychi- score 
damaged atric “‘normals” 
Variable N =22) (N =22) i* Dd (N =45) 
Age 40.91 39.82 305 —_ 30.1 
Education 10.00 10.09 075 — 
Wechsler- Bellevue 
Full Scale IQ 91.95 108.85 3.647 (001 111.9 
Verbal IQ 97.67 106.76 1.897 _— 110.2 
PerformanceIQ 87.49 109.67 4.804 (001 111.6 
Subtest weighted 
scores 
Information 941 10.86 1.571 —_ 11.5 
Comprehension 9.86 11.00 1.356 _— 11.2 
Digit Span 
(total weighted) 6.68 9.14 2.081 (05 11.1 
Digits Forward 
(no. correct) 5.73 6.36 1.518 _— 7.2 
Digits Backward 
(no. correct) 3.91 5.04 2.211 (05 5.6 
Arithmetic 7.09 10.41 2.781 (01 10.5 
Similarities 7.64 9.82 2.390 (05 11.1 
Vocabulary 11.05 10.89 173 — 11.2 
Picture Arrange- 
ment 7.05 10.38 3.112 (01 11.3 
Picture Comple- 
tion 7.32 10.27 3.292 (01 12.2 
Block Design 7.00 10.00 2.988 (01 11.1 
Object Assembly 7.05 10.36 2.971 (01 10.8 
Digit Symbol 4.23 9.14 4.610 (001 10.4 
*df = 35-45. 








Table 2 


Wechs!er-Bellevue Scores for Cases of Focal, Diffuse 
and Subtentorial and Third-Ventricle Lesions 


Sub 
tentoria 
and 3rd 

Focal Diffuse ventricle 


Variable N =11) (N =7 N =4 Fe tf 

Age 37.73 50.71 30.50 5.71 05 
Wechsler- Bellevue 

Full 10 90.09 87.57 105.25 56 

Verbal IQ 95.73 95.71 106.50 64 

Performance IQ 85.64 82.28 103.00 1.82 
Subtest IO equivalents 

Information 97 98 105 

Comprehension 102 96 109 

Digit Span (Forward 

& Backward 86 93 101 

Arithmeti 8&5 92 103 

Similarities 87 89 106 

Vocabulary 106 104 106 

Picture Arrangement 93 R3 100 

Picture Completion 89 92 97 

Block Design 90 85 106 

Object Assembly 90 74 113 

Digit Symbol 70 4 94 

*df = 2/19. 


the 7 diffuse ones. In addition, the 4 cases are 
given in which the lesion did not involve the 
cortex directly, the 2 third-ventricle and 2 
subtentorial tumors. Since there are wide dis- 
crepancies in the ages of these groups, the 
subtest scores are presented as IQ equiva- 
lents rather than as weighted scores. The con- 
version of the subtest scores into an IQ 
equivalent is achieved on the basis of the 
standardization tables in Wechsler (27). Be- 
cause of the paucity of cases, significance tests 
could not be made. 

There is seen to be very little difference be- 
tween the groups of focal and diffuse lesions, 
although both groups showed generally low- 
ered test scores resulting from the brain dam- 
age. In contrast, the 4 noncortical cases 
showed, on the whole, very little intelligence 
test loss when compared with the control 
group. In both the focal and diffuse groups 
the Performance IQ is much lower than the 
Verbal IQ. Among the verbal subtests Vo- 
cabulary, Information, and Comprehension 
did not seem to be adversely affected. 

The significance of these findings is that 
the lowered intelligence resulted from the 
cortical damage itself and seemed to be inde- 
pendent of the nature of the damage. It mat- 
tered little whether the lesion was focal or 
diffuse when the size of the lesion was some- 
what controlled by virtue of the fact that 
both groups had extensive damage resulting 





286 Robert S. Morrow and Joseph C. Mark 


Table 3 


Comparison of Wechsler-Bellevue Scores Between 
Pre-Rolandic and Post-Rolandic Lesions 














Pre- Post- 
Rolandic Rolandic 
Variable (N =4) (N =14) * p 
Age 39.75 43.64 53 — 
Wechsler- Bellevue 
Full IQ 100.25 85.92 1.62 — 
Verbal IQ 105.00 93.07 1.27 — 
Performance IQ 94.50 81.42 1.33 
Subtest IQ equivalents 
Information 103 04 
Comprehension 106 100 
Digit Span (Forward & 
Backward) 96 81 
Arithmetic 100 87 
Similarities 92 82 
Vocabulary 110 103 
Picture Arrangement 101 89 
Picture Completion 92 86 
Block Design 100 8&3 
Object Assembly 91 83 
Digit Symbol 79 73 
*df = 16. 


in death. We could find no typical psycho- 
metric test pattern for either the focal or 
diffuse lesions since both show, on the whole, 
the typical pattern of gross brain damage. 

Table 3 compares lesions anterior to the 
Rolandic fissure with posterior lesions. Here, 
too, the subtest scores are given as IQ equiva- 
lents because of the age difference. On the 
whole the patients in the pre-Rolandic or 
frontal lobe group show only slight intel- 
lectual interference, with most of the func- 
tions falling within the average range or bet- 
ter, except for the low Digit Symbol score. 
The intelligence impairment is much greater 
and much more consistent for those lesions 
which are either completely or almost com- 
pletely in the areas posterior to the Rolandic 
fissure, although the differences are not sta- 
tistically significant. Here average or better 
scores were obtained only on Vocabulary, 
Comprehension, and Information. In both 
cases, again, the Performance IQ was much 
lower than the Verbal IQ. The psychometric 
test pattern for structural brain pathology 
was much more clearly revealed for the group 
of post-Rolandic lesions than for pre-Ro- 
landic ones. While few frontal lobe cases 
were involved in this study, the fact that 
these four cases show only slight impairment 
raises questions about some of the special in- 
tellectual functions ascribed to the frontal 
lobes. 

Direct comparison between lesions of the 


left or dominant and right (nondominant) 
hemisphere is precluded because only two le- 
sions were clearly right-sided and these were 
located in the frontal lobes. Instead, Table 4 
shows the comparison between eight cases of 
left-hemisphere damage with eight that are 
bilateral. The two right-hemisphere lesions 
are also shown but not statistically compared. 
Despite the lack of statistical significance in 
the findings, the left-hemisphere lesions 
showed general loss in Verbal and Perform- 
ance IQ while the bilateral group showed 
lowered Performance IQ only. Vocabulary, In- 
formation, and Comprehension were relatively 
unaffected for both groups, but the main dif- 
ferences were in the low Digit Symbol, Digit 
Span, Arithmetic, and Similarities subtest 
scores for the dominant hemisphere group, 
and low Digit Symbol, Picture Arrangement, 
Block Design, and Object Assembly subtest 
scores for the bilateral group. 


Discussion 


The small number of cases in each cate- 
gory precludes broad conclusions or generali- 
zations. We feel justified in making tentative 
interpretations, however, because of the rarity 
of the instances where precise localization is 
available through autopsy. The Wechsler- 
Bellevue test patterns in this study generally 


Table 4 


Comparison of Wechsler-Bellevue Scores Between 
Left-Hemisphere and Bilateral Lesions 

















Left Right 
hemi- hemi- 
sphere Bilateral sphere 

Variable (N =8) (N =8) ‘* >» (N =2) 
Age 37.12 50.00 2.20 (.06 
Wechsler- Bellevue 
Full IQ 84.12 88.00 521 — 113.5 
Verbal IQ 87.12 99.00 1.591 — 117 
Performance IQ 83.25 78.63 559 — 109 
Subtest IQ equivalents 
Information 92 100 115 
Comprehension 96 100 120 
Digit Span (Forward 
& Backward) 80 92 108 
Arithmetic 73 96 117 
Similarities 80 92 101 
Vocabulary 102 105 132 
Picture Arrangement 95 80 106 
Picture Completion 90 91 115 
Block Design 89 82 109 
Object Assembly 89 75 121 
Digit Symbol 71 79 103 
*df = 14. 


Note.—The data for the two right-hemisphere lesions are 
shown in the last column but since the number is too small, in 
addition to both lesions being in the frontal lobe, no compari- 
sons are made. 
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confirm the test patterns of most of the other 
investigations (21, 27). Some of the slight 
differences are worthy of comment. For ex- 
ample, Allen’s (2, 3, 4) studies of both brain- 
damaged and brain-diseased patients obtained 
scores slightly higher than those of this study, 
but he worked with patients who were pre- 
sumably healthier since they were seen in an 
out-patient clinic. Aita and his group (1) 
compared Wechsler-Bellevue scores of their 
entire brain-injured population with those 
classified into mild, moderate, and severe 
cases. The scores of the severely injured 
group bear a very close resemblance to ours. 
It seems, therefore, that the severity or ex- 
tent of the brain disturbance influences the 
Wechsler-Bellevue test pattern. The unim- 
paired Vocabulary score confirms its useful- 
ness as an index of premorbid intellectual ca- 
pacity as recommended by Babcock (7) and 
others (21, 27). Other factors which might 
be involved in the patterning are contingent 
upon the nature of the disturbance, such as 
the location of the lesion, etc. 

Whether the lesion is focal or diffuse is ap- 
parently of very little importance insofar as 
the effect of severe brain disturbance on the 
Wechsler-Bellevue test results is concerned. 
What seems to be of importance is the cortex 
itself as evidenced by comparisons of cortical 
lesions with subtentorial and third-ventricle 
lesions. Our findings seem to be in substantial 
agreement with those of Anderson (5, 6) who, 
in comparing what he regards as “focalized” 
gunshot wounds in the dominant hemisphere 
with the nondominant ones, reported a higher 
Wechsler-Bellevue Deterioration Quotient for 
the dominant-hemisphere cases. He also in- 
dicated that cases with dominant-hemisphere 
damage show a greater loss of verbal abilities 
while the nondominant-hemisphere cases show 
a greater loss in performance. McFie and 
Piercy (19) found that patients with left- 
sided lesions were inferior on the Weigl Sort- 
ing Test to patients with nondominant, right- 
sided lesions, irrespective of location in the 
frontal, parietal, or occipital lobes. Milner 
found that in left temporal lobe lesions caus- 
ing aphasia the test pattern “. . . is likely 
to be one of severe deficit on verbal tests and 
relatively mild deficit on nonverbal ones” 
(20, p. 55). In our study, six of the eight 


dominant-hemisphere lesions showed some 
form of aphasia yet both Performance and 
Verbal IQ’s were low, the Performance mainly 
because of the Digit Symbol and the Verbal 
mainly because of the Digit Span, Arithmetic, 
and Similarities. Weisenberg and McBride 
(28) showed that right-hemisphere damage 
resulted in lowered performance tests. Milner 
indicated that right temporal lesions in par- 
ticular, as well as right parieto-occipital le- 
sions, interfere with visuomotor functioning, 
mostly in terms of the perception of spatial 
patterns. Since there were in our study. no 
right-hemisphere lesions other than the two 
in the right frontal lobes, the left hemisphere 
was compared with bilateral lesions. The bi- 
lateral involvement was generally similar to 
the reported findings on right-sided lesions in 
that the visuomotor tests were lowest, these 
being Picture Arrangement, Block Design, 
Object Assembly, and Digit Symbol. 

Since the left-hemisphere lesions in this in- 
vestigation showed both verbal and perform- 
ance involvement, the question of aphasia 
merits consideration. Six of the eight domi- 
nant-hemisphere cases were reported as having 
some kind of aphasia, while two of the eight 
bilateral cases were reported as showing dys- 
arthria but no aphasia. The speech impair- 
ment did not seem to interfere directly with 
the test administration. The fact that the 
Vocabulary as well as Information and Com- 
prehension scores are either unaffected or only 
slightly so seems to argue against the lan- 
guage disturbance alone causing the gener- 
ally lowered intellectual functioning. 

Research on cerebral localization has been 
concerned mainly with frontal lobe function, 
as in the work of Goldstein (10, 11, 12), Ry- 
lander (22, 23), and Halstead (13). Hal- 
stead, typically, found that intellectual im- 
pairment was greater in frontal lobe lesions 
than in nonfrontal ones, regardless of whether 
the lesion was unilateral or bilateral, left or 
right. Our findings disagree. He found, also, 
no evidence for mass action by getting no cor- 
relation between extent of lesion and degree 
of impairment. In all, the frontal lobes were 
considered most essential to biological intelli- 
gence with the gradient being from the frontal 
lobes. 





288 


In contrast several studies refute the claims 
of frontal lobe function. Hebb (14, 15, 16) 
in his critical review of the work on the 
frontal lobes, as well as his own evaluation 
of four cases of frontal lobectomy in which 
he found no frontal lobe signs, concluded that 
the evidence on which intellectual defects 
have been attributed to frontal lobe damage 
is very poor. Teuber and his co-workers (24, 
25, 26) found that problem solving in pa- 
tients with posterior lesions is at least as diffi- 
cult as for patients with frontal lobe lesions. 
The Mt. Sinai group under Bender, consisting 
of Battersby and his co-workers found that 
the “intellectual changes noted in patients 
with tumors of the frontal, temporal, parieto- 
occipital or even subtentorial areas were about 
the same in quality, although less frequent in 
the last instance” (8, p. 705). They stated 
that ‘no significant differences between pa- 
tients with pre- or post-Rolandic lesions could 
be found” and concluded that “intellectual 
deficits may be produced by lesions in any 
portion of the cerebral hemispheres, and not 
chiefly by frontal lobe involvement, as some 
authorities are still claiming” (8, p. 712). 
Aita and colleagues (1) compared the de- 
terioration quotients for anterior and pos- 
terior brain-injured patients and found much 
more “deterioration” for the posterior areas. 
In our study there was a difference between 
the frontal lobes and the posterior ones with 
the greater defects being, in general, in the 
post-Rolandic areas. 

In trying to explain the disagreements 
among the different studies one should at- 
tempt to go beyond the problem of undiffer- 
entiated brain disturbance and take into con- 
sideration the following factors: (a) the use 
of matched controls; (8) the extent of the 
lesion; (c) its location in terms of cortical 
versus subcortical, dominance versus non- 
dominance, and pre- versus post-Rolandic 
lesions; (d) the nature of the lesion, such as 
focal versus diffuse, tumors versus vascular 
disturbances, and disease versus injury; (e) 
the stage of the disease, i.e., chronic versus 
acute, etc.; as well as (f) the kinds of tests 
used. Other factors and functions which may 
be of importance in reconciling the discrep- 
ancies might be the roles of factors such as 
aphasia, personality, and visuomotor func- 
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tion. In other words, the total picture of brain 
damage should be considered. 


Summary and Conclusions 


The purpose of this paper was to determine 
the effect of structural brain pathology on in- 
tellectual activity as measured by the Wech- 
sler-Bellevue Intelligence Scale, Form II. The 
results of 22 adult males whose death resulted 
from various forms of brain pathology were 
compared with a control group of 22 psychi- 
atric male patients. The autopsy examination 
reports indicated the nature, extent, and lo- 
cation of the lesions. The following are the 
main findings: 

1. There appears to be a typical Wechsler- 
Bellevue test pattern for gross structural pa- 
thology consisting of significantly lower scores 
in Digit Symbol, Block Design, Digit Span 
(especially Digits Backward), Arithmetic, 
and Similarities. In addition, the Full Scale 
IQ and the Performance IQ, including all of 
the Performance subtests, were significantly 
lower for the brain-damaged population. 
There were no significant differences involv- 
ing the Vocabulary, Information, and Com- 
prehension scores. The seemingly unaffected 
Vocabulary score justifies its use as an indi- 
cator of premorbid intelligence. 

2. Within the brain-damaged population 
significant differences were not found between 
the focal and diffuse lesions, although both 
groups showed lowered scores. The two pos- 
terior fossa and two third-ventricle cases 
showed practically no intellectual impair- 
ment. 

3. Under the conditions of this study there 
is no indication of the so-called frontal lobe 
signs. On the contrary, patients whose lesions 
were located anterior to the Rolandic fissure 
showed far less intellectual loss than those 
with lesions which were post-Rolandic. The 
post-Rolandic lesions showed the typical loss 
and psychometric patterning of gross struc- 
tural pathology. 

4. Comparison between the left- or domi- 
nant-hemisphere lesions and bilateral lesions 
indicated in general that the dominant-hemis- 
phere lesions show significantly lower Verbal 
IQ (mostly Digit Span, Arithmetic, and Simi- 
larities) and Performance IQ (mainly because 
of Digit Symbol) while the bilateral lesions 
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show only lowered Performance scores, in- 
cluding Digit Symbol, Block Design, Object 
Assembly, and Picture Arrangement. 


These results are not compatible with the 


traditional brain theories which emphasized 
the roles of the frontal lobes and dominant 
hemisphere in intellectual functioning. 


Received November 5, 1954. 
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The Awareness of Hostile Feelings in 





Patients 


by Their Nurses” 


Sol Charen 


Catholic University of America 


Subjects were 25 male veteran patients 
hospitalized for six months and longer with 
pulmonary tuberculosis. Mean age was 33 
years with a range of 20 to 56 years, educa- 
tional level was at the mean of 10.5 grades 
with a range of sixth grade to three years of 
college. Associated with the Ss were four 
ward nurses who had daily contact with them 
during this entire period of hospitalization. 

Patients were given the Moldowsky Hos- 
tility Test (1) which consists of 25 items 
from the MMPI dealing with the presence of 
hostile feelings. The nurses rated the patients 
through the Factor H scale, designed to meas- 
ure the feelings of hostility in people (2). The 
correlation between the nurses’ scores on the 
Factor H scale and the patients’ scores on the 
Moldowsky was insignificant, — .113. 

The experiment was repeated when the pa- 
tients were transferred to another ward. After 


1From the Veterans Administration Hospital, 
Baltimore, Maryland. The statements and conclu- 
sions reached in this article are those of the author 
and do not necessarily reflect the opinion or policy 
of the Veterans Administration. 

2An extended report of this study may be ob- 
tained without charge from Sol Charen, 200 Rhode 
Island Ave., N.E., Washington 2, D. C., or for a fee 
from the American Documentation Institute. To ob- 
tain it from the latter source, order Document No. 
4554 from ADI Auxiliary Publications Project, Photo- 
duplication Service, Library of Congress, Washing- 
ton 25, D. C., remitting in advance $1.25 for micro- 
film or $1.25 for photocopies. Make checks payable 
to Chief, Photoduplication Service, Library of Con- 
gress. 


three months’ stay they again filled out the 
Moldowsky and the three nurses from this 
ward rated them with the Factor H. The cor- 
relation was again insignificant (— .017). 
The correlation between the ratings of the 
first group of nurses and the second group 
was .579, significant at the .01 level. Mean 
scores and sigmas for the patients on the test- 
retest situation were almost identical, with the 
correlation between tests being .563. The con- 
clusion which the above correlations between 
nurses’ scores and patients’ scores suggest is 
that the nurses seem to have been rating ex- 
ternal behavior of the patients although the 
Factor H scale calls for a measure of internal 
feelings and attitudes. There is obviously 
better than chance ability on the part of the 
two groups of nurses to agree in their esti- 
mation of a patient’s hostility, less however 
to really know how he feels in this area. 
Despite close association with the subjects 
neither group of nurses gives test evidence for 
empathy. 
Brief Report 
Received March 29, 1955. 


References 


1. Dinwiddie, F. W. An application of the principle 
of response generalization to the prediction of 
aggressive responses. Unpublished doctor’s dis- 
sertation, Catholic Univer. of America, 1954. 

2. Lorr, M., Rubenstein, E., & Jenkins, R. L. A fac- 
tor analysis of personality ratings of outpa- 
tients in therapy. J. abnorm. soc. Psychol. 
1953, 48, 511-514. 


290 








Journal of Consulting Psychology 
Vol. 19, No. 4, 1955 


Psycnological Changes over a Three-Year Period 
Following Bilateral Prefrontal Lobotomy’ 


Isidor W. poll John F. Winne, 
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and Robert W. 


Baker 


Clark University 


In a previous publication (1), the authors 
reported an investigation of the changes in 
psychological tests of male schizophrenic pa- 
tients during the first year following prefontal 
lobotomy. This paper represents an extension 
of that report to the third year following 
surgery. 

As has been discussed at length elsewhere 
(1, pp. 1-2), the study was so designed as to 
take into account several criticisms which 
may be made of preceding studies of lobot- 
omy: (a) failure to control time intervals be- 
tween successive assessments; (0) failure to 
use control groups as a baseline in terms of 
which changes in the operated group must be 
evaluated; (c) failure to use a wide variety 
of psychological measures; and (d) failure to 
integrate test findings with all available clini- 
cal data. 


Experimental Procedure 


Subjects. Fifty white male schizophrenic pa- 
tients at the Veterans Administration Hospital, 
Northampton, Massachusetts, have served as 
subjects during some phase of this three-year 
study. Of these patients, 28 were lobotomized, 
the operation consisting of a standard open 
Lyerly-Poppen approach (1, p. 6) while the 
remaining 22 constituted the control group. 


1 From the Veterans Administration, Northampton, 
Massachusetts. An abstract of this paper was pre- 
sented to the American Psychological Association, 
New York, September, 1954. The authors wish to 
thank Dr. Frank Politzer and Dr. Robert Fortier for 
their assistance in administration of the test battery 
and Dr. Cesareo Pefia and Dr. Arnold Trehub for 
critical review of the manuscript. 


The subjects for the present study con- 
sisted of 20 lobotomized and 16 nonlobotom- 
ized patients, fairly well equated for age, edu- 
cation, length of hospitalization, diagnostic 
classification, and degree of cooperativeness. 
All patients had received electroconvulsive 
treatment, which was unsuccessful or only 
temporarily beneficial, and all had been se- 
lected as suitable candidates for lobotomy by 
the medical staff of the hospital. 

Test materials. The experimental materials 
consisted of a battery of 27 tests from which 
113 measures were derived. A description of 
the tests employed, and the measures derived 
from them, may be found elsewhere (1, pp. 
6-10). Insofar as possible, the test battery 
was group administered to the operated pa- 
tients about three weeks before, and two 
weeks, three months, one year, and three 
years after lobotomy. The control group was 
similarly tested at comparable time intervals. 
Tests with published manuals were scored 
according to the prescribed procedure; the 
evaluation of qualitative data was accom- 
plished through group judgment of three 
clinical psychologists (not including the au- 
thors). 

Analysis of data. Each of the 113 variables 
was examined in order to ascertain the sta- 
tistical significance of the met change in the 
experimental group relative to the control 
group from testing to testing, using either ¢ 
tests or net shift in proportion (for dichotom- 
ized data). The emphasis, statistically, was 
on determining the net change in the oper- 
ated group over and above the change ob- 
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served in the control group for the particular 
time period under consideration. 


Problem of the Study 


Four major conclusions were derived from 
the analysis of the data obtained in the one- 
year study (1). These were: (a) There is a 
tendency toward decreased mental efficiency 
at one year, associated possibly with organic 
alteration; (6) ego boundaries are strength- 
ened, although a downward trend in the di- 
rection of weakened ego boundaries was noted 
in a comparison of the results at three months 
and one year after operation; (c) sexual 
awareness and differentiation are increased 
throughout the entire period, reflecting con- 
cern regarding the role which the patient as- 
sumes in interpersonal relationships; and (d) 
there is an increase in the rate of action, pos- 
sibly reflecting a diminution of inhibitory fac- 
tors. Related to d, perhaps, are tendencies 
toward lack of inhibition in the moral-social 
field. 

The problem in the present study was pri- 
marily to ascertain the course of the test 
measures relevant to these conclusions, with 
particular emphasis on the period from one 
to three years following operation. Secondly, 
the data derived from all of the 113 measures 
were examined in order to ascertain the 
changes within the experimental group and 
within the control group, as well as the net 
change in the experimental group, for the en- 
tire period from before lobotomy to three 
years after lobotomy.” Finally, qualitative 
material obtained from observation of the 
patients in several different types of activi- 
ties and from psychiatrists’ progress notes 
was examined in an effort to determine any 


2 Tables giving, for each measure, the number of 
cases, means, the standard error of difference, t, and 
? for the changes within the experimental and con- 
trol groups and for the net change in the operated 
group during the period from before operation to 
three years after operation and for the period from 
one year after operation to three years after opera- 
tion have been deposited with the American Docu- 
mentation Institute. Order Document No. 4556 from 
ADI Auxiliary Publications Project, Photoduplication 
Service, Library of Congress, Washington 25, D. C., 
remitting in advance $2.00 for microfilm or $3.75 for 
photocopies. Make checks payable to Chief, Photo- 
duplication Service, Library of Congress. 





Isidor W. Scherer, John F. Winne, and Robert W. Baker 


additional dimensions of difference between 
lobotomized and nonlobotomized schizophren- 
ics over the three-year period. 


Results 


Changes during the period from one to 
three years following lobotomy. First to be 
considered are changes in those variables re- 
lated to the first conclusion from the earlier 
study. 


There is a predictable pattern of test perform- 
ance following lobotomy. Performance on tests meas- 
uring mental efficiency and organicity (malfunction 
due to organic factors) drops sharply during the 
two-week postoperative period. As recovery from the 
operation takes place, test performance returns to 
the preoperative base line or rises slightly above it, 
reaching a peak, in our study, at three months post- 
operation. There then appears to be a trend toward 
decline, such that the performance in some tests at 
one year postoperation falls below the base line, al- 
though several tests remain above (1, p. 20). 


In the period from one to three years after 
prefontal lobotomy, a definite pattern sug- 
gesting improvement is noted. Of the 29 meas- 
ures selected as pertinent to this variable, 15 
show a shift, at the .20 level of significance 
or better, in the direction of increased men- 
tal efficiency during this time period. There 
are mo measures which show a statistically 
significant net change in the negative direc- 
tion. This over-all result is significant at the 
01 level, when tested with x* as described 
elsewhere (1, p. 10). The measures, together 
with the associated p values, are presented in 
Table 1, where H indicates a change in score 
signifying better efficiency. Thus, for example, 
abstraction as measured by the score on the 
Object Sorting Test is improved from one to 
three years after operation (p < .01); mem- 
ory is improved, as indicated by increased ac- 
curacy in Visual Memory (p < .05) and more 
correct recollections in delayed recall on the 
Babcock Memory Paragraph (p < .01). Thus, 
the tentative trend toward reduced efficiency 
which had been observed during the first year 
is not continued, and, in fact, appears to be 
reversed. 

The second conclusion held that ego bound- 
aries are relatively strengthened one year fol- 
lowing lobotomy. However, examination of 
the changes between three months and one 
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Table 1 


Direction of Net Change in Measures of Mental 
Efficiency from One to Three Years 
Following Lobotomy 








Net 
change p 


Measure 


Organic Signs 
Word Association 
Phrases (83) H O1 
Close (84) ind sais 
Personal (87) sony -=' 
Draw-a-Man 
Shading (69) —_ = 


Accuracy (65) H .20 
Heavy Lines (71) H .20 
Visual Memory 
Heavy Lines (12) H .20 
Abstraction 
Categorization (57) H 10 


Similarities (51) -— — 
Shipley Hartford Rights (55) — 


Object Sorting (48) H O1 
Motor 

Tweezer Dexterity (31) H 05 

Downey: Total Time (37) H .20 


Halstead: Right Hand (38) — -— 
Motor Memory 


Halstead 
Both Hands (40) H 05 
Right-Left (41) — — 
Positions (44) H .10 
Memory 


Hard Pairs (9) — — 
Visual Memory 
Accuracy (10) 
Memory Par 
Immed. Right (18) 
Delay Right (21) 
Total Right (24) 
Immed. Distortions (19) 
Distorted Order (23) 
Digit Span 
Weighted Score (5) 
Cognitive 
Digit Symbol 
Errors (1) — 
Weighted Score (2) H 
Trailmaking 
Errors (59) —- 
Serial Seven 
Errors (7) —- — 


a0) 


.20 
.20 


ma | mo | 


| 
| 


z | 
vi 





Note.—The number in parentheses refers to the measure as 


defined in the one-year report (1, pp. 6-10). H indicates 
higher mental efficiency, — indicates no change in mental 
efficiency. 


year after operation, although somewhat un- 
clear, suggested that a trend in the direc- 
tion of weakened ego boundaries had set in. 
Table 2, which lists the relevant measures, 


again demonstrates a reversal of trend dur- 
ing the period from one to three years after 
operation. Of 21 measures studied, 8 are seen 
to shift, at the .20 level of confidence or bet- 
ter, in the direction of strengthened ego 
boundaries. One measure, the number of 
omitted items on Word Association, moves 
contrary to the general pattern, with an as- 
sociated p value between .10 and .20. This 


Table 2 


Direction of Net Change in Measures of Strength of 
Ego Boundaries from One to Three Years 
Following Lobotomy 


Net 
Measure change f 





Memory 
Digit Span 
Forward (3 
Memory Par 
Immed. Right (18 
Delay Right (21 
Total Right (24 
Halstead 
Positions (44 H 10 
Cognitive 
Digit Symbol 
Weighted Score (2 H 05 
Halstead 
Right-Left (41) 
Right-Both (42) - 
Vocabulary (17 
Body Image 
Draw-a-Man 
Accuracy (65) H 20 
Contact Measures 
Rorschach 
Rejections (126) 
Multiple Choice Rorschach 
Rejections (138) 
Crude C responses (141 
Szondi 
p positive (105 
p negative (106) 
Word Association 
Personal! (87) . 
Omits (82) L 20 


Tweezer Dexterity 

Lev of Asp (30) H .20 
Attitude to God 

Positive (114) H 05 

Negative (115 H 01 
Aversion 

Staying at Home (118) H .20 








Note.—The number in parentheses refers to the measure as 
defined in the one-year report (1, pp. 6-10). Av indicates 
increased, L indicates decreased, - 


indicates no change in 
strength of ego boundaries. 
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Table 3 


Direction of Net Change in Measures of Sexual 
Awareness and Concern from One to Three 
Years Following Lobotomy 











Measure change p 


Bender Gestalt 
Angle Difficulty (77) H 05 
Draw-a-Man 
Sexual Confusion (66) _— 
Accuracy (65) H .20 
Nose Size (64) — 
Draw-a-Woman 


Shift in Breast Size (61b) H .20 
Rorschach 

Reaction Time, Card VI (132) H 01 
Aversion 

Masturbation (122) H 05 

Incest (119) H 01 

Deviant Sexual Behavior (120) H 10 





Note.—The number in parentheses refers to the measure as 
defined in the one-year report (1, pp. 6-10). H indicates 
increased, L indicates decreased, — indicates no change in 
sexual awareness and concern. 


over-all result is significant at the .01 level. 
We see, in Table 2, that measures of memory 
and cognition improve (p varies between .10 
and .01), that more positive (p < .05) and 
fewer negative (p< .01) attitudes toward 
God are expressed, and that level of aspira- 
tion is increased (p > .10 < .20). 

The third conclusion held that there is an 
increased awareness of sexuality following 
lobotomy which appears to be maintained for 
at least three months. Although this increase 
appeared to be present at one year, the course 
during the last half of the first year after 
operation was somewhat equivocal. Table 3, 
which presents the nine measures pertinent 
to this variable, indicates that sexual aware- 
ness increases during the period from one to 
three years after lobotomy. The over-all re- 
sult is presumed to be significant at the .01 
level, or better. Seven of the nine measures 
shift in a positive direction at the .20 level of 
significance or better. For example, we find 
increased aversion toward masturbation, in- 
cest, and deviant sexual behavior (p varies 
from .01 to .10), increased reaction time to 
Rorschach Card VI (p< .01), and better 
delineation of the sex in drawings of human 
figures (p > .10 < .20). Again, there are no 


measures which shift in a direction contrary 
to the general pattern. 

The fourth conclusion maintained that there 
is an increase in the rate of action in lobotom- 
ized patients during the first year following 
lobotomy—that is, the operated patients 
tended to act more hurriedly or impulsively 
than did their controls. Table 4, which lists 
the direction of net change in the 24 relevant 
variables, exhibits an interesting phenomenon. 
Changes in three out of four tests which are 
primarily motoric (Total Inhibition score of 


Table 4 


Direction of Net Change in Measures of Rate of Action 
and Impulsivity from One to Three Years 
Following Lobotomy 


Net 
Measure change p 
Motor 
Downey Inhibition 
Total Time (36) H .20 
T;—T; (37) H 10 
Finger Dexterity (29) — 
Tweezer Dexterity (31) H 05 
Cognitive 
Digit Symbol 
Weighted Score (2) H 05 
Serial Seven 
Time (6) _ 
Word Association 
Time (88) — 
Rorschach Reaction Times 
Card III (129) L .20 
Card IV (130 ‘& 05 
Card V (131) L .20 
Card VI (132) L 01 
Card VII (133) L 05 
Card VIII (134) L .20 
Card IX (135) L .20 
Card X (136) . 10 
Aversion Items 
Murder (116) -— — 
Theft (117) L .20 
Incest (119) L 01 
Deviant Sexuality (120) L .20 
Withdrawal (121) — — 
Masturbation (122) L 05 
Cannibalism (123) — — 
Expansiveness 
Visual Memory 
Size (11) L 01 
Draw-a-Woman 
Size (60) L 05 





Note.—The number in parentheses refers to the measure as 
defined in the one-year report (1, pp. 6-10). H indicates 
increased, L indicates decreased, — indicates no change in 
rate of action or impulsivity. 
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the Downey Will-Temperament Test, the dif- 
ference between the first and third trials of 
the Downey, and the O’Connor Tweezer Dex- 
terity Test) suggest that the rate of motoric 
action continues to increase during the period 
from one to three years following operation. 
Perhaps related to this is the increased score 
in Digit Symbol, a written test which in- 
volves speed of motoric action. On the other 
hand, the data obtained from all Rorschach 
reaction times, two measures of expansiveness, 
and four out of seven measures of moral- 
social attitude suggest that lobotomized pa- 
tients become less impulsive and less likely to 
act rapidly in tests involving ideation or 
imagination. 

In summary to this point, we see that 
lobotomized patients show the following net 
changes in the period from one to three years 
after operation: (a) a general improvement 
in tests of mental efficiency; (5) a strength- 
ening of ego boundaries; (c) a continued in- 
crease in awareness of sexuality; (d) an in- 
creased rate of motoric action; and (¢) more 
inhibition or a lesser readiness to act rapidly 
on tests involving imagination or ideation. 

Changes over the three-year period, This 
paper has been concerned thus far with 
changes attributable to lobotomy with refer- 
ence to the period from one to three years 
following surgery. Next to be considered are 
the changes over the whole time span em- 
ployed—i.e., from immediately before lobot- 
omy to three years following lobotomy. Very 
briefly, tests of significance of the net change 
in the operated group indicate that only 4 of 
the 113 measures show impairment which is 
statistically significant at the .20 level or 
better: Digit Symbol Errors, Trailmaking 
Errors, Word Association Omits, and Aver- 
sion to Cannibalism. Twenty-three measures 
show significant net gain, while the remain- 
ing 86 measures show no change. Since these 
results differ from a chance distribution at the 
01 level, it may be concluded that the op- 
erated patients either held their own or did 
better on psychological tests over the three- 
year period than did their controls. 

Since the interpretation of many of the 113 
measures may be open to question, a group 
of 40 clear-cut measures of functional effi- 
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ciency were analyzed in detail.’ Table 5 pre- 
sents these measures, the direction of change 
within the experimental and control groups 
for each of the four testings after operation, 
and the net change in the experimental group 
over and above the change in the control 
group. All changes shown are statistically sig- 
nificant at the .20 level or better.* 

The data presented in Table 5 suggest that 
the experimental group, except at the second 
testing, tends to have better efficiency than 
evidenced prior to lobotomy. For example, 
three years after lobotomy, gains are shown 
in 24 tests, no change in 12 tests, and deficit 
in only 4—increased errors on Digit Symbol 
(p < .05), increased errors on Trailmaking 
(p < .10), and increased confusion in se- 
quence for immediate and delayed recall of 
the Babcock Memory Paragraph (p > .10 - 
.20). The control group, on the other hand, 
shows considerable gain when tested for the 
second time, probably as a result of practice, 
but by three years has returned essentially to 
the level attained at the beginning of the ex- 
periment. 

The final section of the table indicates the 
relative loss in efficiency of the operated 
group two weeks after lobotomy, followed by 
a slow but steady rise over the remainder of 
the three-year period. We believe that the 
failure to improve in tests of functioning effi- 
ciency—in spite of repeated exposure to the 
test materials—on the part of the nonoper- 
ated group is one aspect of the regressive 

% Tables giving, for each of the 40 measures, the 
number of cases, means, the standard error of differ- 
ence, t, and » for the changes within the experimen 
tal groups and for the net change in the operated 
group for the periods (a) Pre-2 week post, (b) Pre-3 
month post, (c) Pre-1 year post, and (d) Pre-3 year 
postoperation have been deposited with the American 
Documentation Institute. Order Document No. 4557 
from ADI Auxiliary Publications Project, Photodupli- 
cation Service, Library of Congress, Washington 25, 
D. C., remitting in advance $1.75 for microfilm or 
$2.50 for photocopies. Make checks payable to Chief, 
Photoduplication Service, Library of Congress. 

*It will be noted that there is considerable over- 
lap between the measures presented in Table 5 and 
those presented earlier in Table 1 and Table 2. 
Table 5 includes all measures adjudged to yield un- 
equivocal interpretation while Table 1 and Table 2 
include only those measures which showed signifi- 
cant net change at some period during the three 
years following lobotomy. 
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Table 5 


Direction of Change from Preoperative Baseline in Forty Tests of Functioning 


Efficiency over a Three-Year Period 























Experimental group Control group 
Measure 2wk. 3mo. lyr. 3yr. 2wk. 3mo. lyr. 3yr. 

Digit Symbol 

Errors (1) _- _-_ — L H - L 

Score (2) — H H H H — H — 
Digit Span 

Forward (3) —_ — L — H H H 

Reversed (4) - — — H ~— H H 

Weighted Score (5) = L - H H H H 
Serial Sevens 

Time (6) a H H — H - 

Errors (7) . L - — - . ~ 
Hard Pairs (9) H H H H H 
Visual Memory Rights (10) — — H H - L H L 
Vocabulary (17) — — H H — L -_ — 
Memory Paragraph 

Immediate Rights (18) H H — H H H L - 

Delay Rights (21) - oa H — H - 

Average Rights (24) — H H H H - 

Immediate Distortions (19) L — H H H H H - 

Delay Distortions (22) — — HH H — - H 

Average Distortions (25) - H H H H 

Immed. Distorted Order (20) ~ — L L — L L 

Delay Distorted Order (23) — = L L L . L 
Finger Dexterity Time (29) H H H H = H — 
Tweezer Dexterity Time (31) — HH _-_ — — - — 
Downey Total Time (36) L L - — H H 
Halstead 

Right Hand (38) -= — H -— H H H — 

Left Hand (39) — H H H H H H H 

Both Hands (40) - — H H H H - 

Shapes (43) - . - —- — H - 

Position (44) _-_ — _-_ — — - H — 
Object Sorting 

Score (48) _ — H — — H H — 

Confabulation (49) — - —_— H - ~ H 

Symbolism (50) —-_ —- —_—_ — — — 
Similarities (51) —_ — — FH H — 
Series Completion (53) — H H H H — 
Shipley Hartford (55) H H H H H H H 
Categorization (57) L — — dH — : — 
Trailmaking 

Time (58) — H H — H H H 

Errors (59) —_ — I L H -_ — 
D-a-W Confusion (62) H — oH H H — _-_ — 
D-a-M Accuracy (65) — H — HH — L _ — 

Confusion (66) H — H H _ L I L 
Bender-Gest. Elaboration (75) L H H H — L - 4H 
Word Association Recall (81) — _ — — = - L 
Number of Measures showing 

Gain 5 13 19 24 18 13 12 10 

No change 31 24 17 12 21 + ee: ee 

Loss 4 3 4 4 1 5 5 7 





Net change 





2wk. 3mo. lyr. 3 yr. 





— HH — HH 
L L — L 
i L — wal 
L L —-— — 
— H 
— - H 

— H H 
nie H - = 
H H H 

- - H 
L - 
L - 

- ~ H 
L 
H H H - 
L J - 

L I I 

L — — 

— L 

L I - - 
I , ons 
I H H 
~— - H H 
L - H 
I — L L 
— FH — #H 
— H H H 
L map bed PE) ale 
—- — — 

2 10 7 12 
a a OR 26 
13 7 2 2 





Note.—The number in parentheses refers to the measure as defined in the one-year report (1, pp. 6-10). H indicates increased, 
L indicates decreased, — indicates no change in functioning efficiency. 
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character of schizophrenia. Further study of 
the apparent differential in this aspect of the 
regressive process is now underway, utilizing 
data obtained from the two groups five years 
after lobotomy. 

Additional differences between lobotomized 
and nonlobotomized schizophrenics. The re- 
sults which have been presented thus far have 
been largely quantitative in nature and con- 
vey a somewhat favorable connotation for the 
lobotomized patient. However, qualitative 
study of the behavior of operated patients and 
controls during the testing situation, ward 
activity, and in group and activity therapies 
suggests that in certain respects the operated 
group is not doing as well as the nonoperated. 
Although lobotomized patients appear to be 
more cooperative, they exhibit a great deal of 
childishness, lack of motivation, lack of goal- 
oriented behavior, concreteness of thinking, 
and irresponsibility—modes of behavior which 
do not seem to be related directly to the nu- 
merous test measures associated with func- 
tioning mental efficiency. Moreover, examina- 
tion of psychiatrists’ progress notes does not 
indicate that there is greater clinical improve- 
ment in the lobotomized patients than in their 
controls. 


Discussion 


The final portion of this report will first 
present briefly some possible explanations for 
the findings of increased cooperativeness and 
efficiency in the lobotomized patients. The ap- 
parent discrepancy between test performance 
and clinical status which was noted in the 
previous section will then be considered. 

First, it appears that the immediate reac- 
tion of patients to the operation includes fea- 
tures such as would be found in any indi- 
vidual suffering cerebral trauma. Immediately 
after lobotomy such typical organic manifes- 
tations as increased irritability, concreteness, 
confusion, temporary release of repression, 
and a temporary defensive regression were ob- 
served. It appears that some of these factors 
work together to establish a degree of con- 
tact with the environment which was absent 
prior to the operation. The increased contact 
allows opportunity for social interplay and 
results in a breakdown of prelobotomy tend- 
encies toward isolation. 
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A second factor to which we may point for 
explanation is the commonly observed reduc- 
tion, following lobotomy, of anxiety asso- 
ciated with pathological preoccupation. This 
diminution of anxiety seems to remove the 
need to create new symptoms or to introduce 
other defensive measures, and so releases 
psychic energy for employment in the solu- 
tion of reality-related problems. This could 
account for increased efficiency on psycho- 
logical tests. 

Third, it is possible that the reduction in 
the strength and number of morbid symp- 
toms is in part the result of some degree of 
disorganization or interruption of ingrained 
thought processes which created the patho- 
logical defenses. In addition, the pathological 
defenses per se become “shaken up” by the 
organic assault so that they do not operate 
as effectively. Consequently, the possible dele- 
terious effect of these pathological defenses on 
functioning efficiency is reduced and, con- 
comitantly, the opportunity is created for 
new modes of expression of psychic energy. 

Despite the increased efficiency noted on 
psychological tests, qualitative study of the 
clinical behevior of lobotomized patients does 
not appear to show the same positive gains. 
In part, this may be due to lack of clear 
knowledge of what the tests measure. Al- 
though memory, abstraction, contact, etc. are 
defined operationally, there is no certainty 
about the relationship of the definitions to 
their corresponding clinical concepts. More 
importantly, there appears to be no reason 
why performance on psychological tests should 
parallel that behavior which is considered in 
judgments of clinical status, since the latter 
represent different facets of the total per- 
sonality and may depend, for measurement, 
on different variables. Performance on tests 
seems to depend on intelligence, cooperative- 
ness, and the amount of psychic energy avail- 
able for use in the solution of the problems 
which are presented, while judgments of clini- 
cal status depend upon a host of variables, 
many of which are ill defined or in the realm 
of subjectivity. 

‘Moreover, the apparent lack of gain in 
clinical status may arise because the lobotom- 
ized patient is making more numerous con- 
tacts with his environment and is likely to be 
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more demanding on the ward personnel. In a 
sense, symptoms which are ordinarily en- 
capsulated are more likely to be released and 
expressed following the operation. Because of 
this, observers are more apt to notice the op- 
erated patient’s psychotic ideation and be- 
havior than those of his less demanding and 
less active control and, consequently, adverse 
clinical judgments may be made. 


Summary 


This study deals with the changes in psy- 
chological tests in a group of schizophrenic 
patients during the three years following 
lobotomy, with particular emphasis on the 
period from one to three years following op- 
eration. The subjects consisted of 20 male 
white lobotomized schizophrenics and 16 non- 
lobotomized controls, all fairly well equated 
for age, education, length of hospitalization, 
diagnostic classification, and degree of co- 
operativeness. 

All lobotomized subjects were group tested 
about three weeks before, and two weeks, 
three months, one year, and three years fol- 
lowing lobotomy. Controls were similarly 
tested at comparable time intervals. The test 
battery consisted of 27 psychological tests 
from which 113 relatively independent meas- 
ures were derived. The data obtained from 
each of the 113 measures were examined to 
ascertain the significance of the met change 
in the experimental group in the period from 
one to three years following lobotomy. Sec- 
ondly, statistical tests were made of the dif- 
ferences within the experimental group, within 
the control group, and of the met change in 
the experimental group for the period from 
prior to operation to three years after op- 
eration. 

The results are as follows: 

1. Lobotomized patients show the following 
net changes in the period from one to three 
years after operation: (a) a general improve- 
ment in tests of mental efficiency; (5) a 


strengthening of ego boundaries; (c) a con- 
tinued increase in awareness of sexuality; 
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(d) an increased rate of motoric action; and 
(e) more inhibition or a lesser readiness to 
act rapidly on tests involving imagination or 
ideation. 

2. Lobotomized patients generally did bet- 
ter on psychological tests over the three-year 
period than did their controls. 

3. Lobotomized patients, except at the 
testing two weeks after lobotomy, tend to 
have better efficiency than that evidenced 
prior to lobotomy. 

4. Control patients show considerable gain 
on the second testing, but at the end of the 
three-year period have returned essentially to 
the level attained at the start of the experi- 
ment. It is suggested that this lack of im- 
provement in spite of practice on the tests is 
one aspect of the regressive character of 
schizophrenia. 

5. Qualitative analysis of the lobotomized 
patients’ behavior and examination of psychi- 
atrists’ progress notes suggest that in some 
respects the operated group is not doing as 
well clinically as the nonoperated group. 

6. It is suggested that the increased effi- 
ciency on psychological tests evidenced by 
the operated group is due to (a) increased 
contact, (b) lessened anxiety which releases 
psychic energy for use in the solution of re- 
ality-related problems, and (c) disorganiza- 
tion of the pathological defenses as a result 
of the organic assault. 

7. It is suggested, also, that the discrep- 
ancy, in the operated group, between psycho- 
logical efficiency and clinical behavior may 
be due to (a) ill-defined test and clinical 
measures and (6) release of formerly en- 
capsulated symptomatology which may en- 
courage adverse judgments by ward observers. 


Received November 10, 1954. 
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Diagnosis of Organicity by Means of Spiral Aftereffect 


A. Cooper Price 
VA Center, Biloxi, Mississippi 


and H. L. Deabler 
VA Hospital, Gulfport, Mississippi 


One of the persistent problems facing a 
clinical psychologist working in a hospital 
setting is that of having a reliable and valid 
test for determining organic brain damage. 
Recent reports on the more frequently used 
tests such as the Rorschach, Wechsler-Belle- 
vue, and others tend to cast some doubt on 
their ability for consistent differentiation of 
organic from nonorganic cases (9). 

In 1949, Freeman and Josey (1) published 
a study in which ability to perceive a certain 
spiral aftereffect by patients with memory 
impairment was investigated. They rotated an 
Archimedes spiral for a period of time after 
which rotation was stopped. Normal subjects 
experienced a visual negative afterimage or 
effect of either expansion or contraction of 
the spiral immediately after the rotation was 
stopped. This apparent movement aftereffect 
has been referred to elsewhere as gamma 
movement (3). Freeman and Josey reported 
that most of their subjects (Ss) with clini- 
cally judged memory impairment did not re- 
port or were unable to perceive this distinc- 
tive aftereffect. 

The results of their study led the present 
authors to believe that this phenomenon 
might be utilized for development of a tech- 
nique for detection of organic brain involve- 
ment. It was hypothesized that nonorganic 
patients would be able to perceive the distinc- 
tive aftereffect while organic patients, espe- 
cially those with cortical involvement, would 
be unable to perceive it or if they did per- 
ceive it, their perception of it would be in- 
complete. It was decided that research should 
be conducted to verify this hypothesis and, if 


results were favorable, to develop this tech- 
nique as an aid for diagnosis of organicity. 


Method 


Apparatus. An electric motor and stand 
commonly used for color mixing experiments 
was used to produce the necessary rotation. 
To the shaft, an opaque disk of white plastic 
6 inches in diameter was attached. An Archi- 
medes spiral of 920° or 21% circuits about 
the center was constructed of dark colored 
plastic and was placed against the white disk 
background. The spiral was reversed for the 
effect of opposite rotation. The disk was 
turned at approximately 100 revolutions per 
minute. It was later found that a spiral could 
be rotated on a phonograph turntable of 
78 rpm with identical results. 

Procedure. Testing took about five minutes 
per S and was conducted only in the daytime 
when illumination was good. The S was seated 
approximately 8 feet from the apparatus. 
Standard instructions were given immediately 
preceding the test as follows: “This is a spe- 
cial eye test (so stated in order to get at- 
tention and cooperation from psychotic Ss). 
Look at the center (pointing) and don’t take 
your eye away until I tell you to.” Then the 
rotation was begun. Spiral A, giving normal 
Ss a negative aftereffect of expansion, was 
presented first in half of the cases for 30 sec- 
onds. This was ample time for normal and 
other Ss. While the disk was rotating S was 
asked “What does the line appear to be do- 
ing?” This was done to make sure S was at- 
tending and could report his experience. After 
30 seconds, the disk was stopped and S was 
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then asked immediately, “Now what does the 
line appear to be doing?” The patient’s an- 
swer was recorded. The routine was repeated 
with the spiral reversed (Spiral B), giving 
normal subjects a negative aftereffect of con- 
traction. This was followed by a repetition of 
presentation of A, then B for a total of four 
trials of 30 seconds each. Each normal report, 
that is, seeing the negative aftereffect cor- 
rectly, was scored 1. Each abnormal report, 
that is, failure to perceive the negative after- 
effect, was scored 0. Reports of aftereffect in 
which no apparent change of dimension oc- 
curred but in which apparent motion forward 
or backward was reported, were given a score 
of 1%. Also, a doubtful or equivocal report was 
scored 14. The Ss scored a total of 4, 3, 2, 1, 
or 0 depending on the degree of their percep- 
tion of the aftereffect. In the case of normals 
the negative aftereffect was so immediate and 
vivid that it was scarcely necessary to con- 
duct the usual inquiry for scoring. There was 
little ambiguity as to the presence or absence 
of the aftereffect with most Ss. In the inter- 
ests of conservatism, to give S the benefit of 
a doubtful response, fractional or half scores 
were raised to whole scores in final computa- 
tion. 

Strict adherence to the procedure for the 
testing of Ss was exercised. It was believed 
that variations from the standard directions 
might have considerable bearing upon the va- 
lidity of the results obtained. Precaution was 
taken not to suggest or structure in any way 


Table 1 


Aftereffect Score 

















Perception 
Com- 
None Partial plete 
Subject 
group OScore 1 2 3  4Score 
Normal 0 1 0 2 37 
(NV = 40) 0% 25% 0% 5% 92.5% 
Nonorganic 
psychiatric 0 0 1 1 38 
(N= 40) 0% 0% 2.5% 25% 95% 
a 
Organic 72 13 24 9 2 
(N= 120) 0% 10% 2% 8% 2% 
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the nature of the perception being investi- 
gated. 

In order to demonstrate the perceptual 
aftereffect to be cortical phenomenon and not 
retinal (2), several normal Ss were tested 
with one eye covered. At the end of the 30- 
second exposure period, the rotation was 
stopped. At that time the Ss were instructed 
to cover the eye which had been used to view 
the rotating spiral and to use the other to 
view the now motionless disk. It was found 
that the aftereffect occurred just the same. 

Subjects. The VA Hospital at Gulfport, 
Mississippi and the VA Center at Biloxi, 
Mississippi, supplied the Ss for this study. 
Three groups were used: 

1. Forty normal adult males employed at 
the institutions at the time of testing, with no 
known history of organic involvement. 

2. Forty nonorganic psychiatric cases. The 
diagnoses of these were based on hospital staff 
action. The group was composed of schizo- 
phrenics, manic-depressives, and neurotics. 
Patients recently or currently undergoing 
electroconvulsive treatment were not used in 
the study, since it is known that this form of 
treatment may produce temporary organic 
effects (4). 

3. One-hundred and twenty organic cases 
with known cortical involvement. Diagnoses 
of these cases were based on hospital staff 
action. This group included cases of CNS 
syphilis, cerebral vascular accidents, chronic 
brain syndrome associated with alcoholism, 
cerebral arteriosclerosis, post-traumatic ence- 
phalopathy, and advanced stages of Parkin- 
son’s disease. 


Results 


Scores of Ss in the three groups and per- 
centage computations are given in Table 1. 

The chi-square technique was used to de- 
termine the possibility of a statistically sig- 
nificant difference between the organic and 
the nonorganic cases. Chi square for these 
data was found to be significant at the .001 
level of confidence. 


Discussion 


Functional psychiatric cases were presumed 
to be without organic brain damage. The test 
data confirm this hypothesis, cases in this 
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group being able to perceive the aftereffect to 
a marked degree. The normal and the func- 
tional psychiatric Ss showed no significant 
difference in their performance. 

Standlee recently published an article (7) 
on the spiral aftereffect as an indication of 
memory impairment with conclusions differ- 
ing from those of Freeman and Josey (1) 
and with implications from our study. He ad- 
ministered the spiral test to 16 normal and 
25 psychotic Ss and found that all were able 
to perceive the aftereffect. He also gave these 
same Ss the Wechsler Memory Scale and 
found that their Memory Quotient scores 
ranged from below 48 to above 143, lower 
and upper limits of the scale, with low scores 
indicating poor memory ability and high 
scores indicating superior memory ability. He 
reasoned from this wide variation in memory 
ability scores and from the aftereffect report 
of each of his Ss that “Freeman and Josey’s 
‘strong probability of correlation’ between the 
visual phenomenon and memory ability is not 
confirmed” (7, p. 317). Standlee has, how- 
ever, made a crucial error in his reading and 
interpretation of Freeman and Josey’s study, 
for they specifically stated that they were at- 
tempting to deal with memory impairment, 
not with variations in general memory ability. 
A distinction exists and must be made be- 
tween these two conditions. A given individual 
may have low memory ability and may not 
have suffered from any type of brain damage 
or memory impairment. One of our nonor- 
ganic psychiatric Ss, for instance, was a pri- 
mary mental defective, and he was able to 
perceive the aftereffect completely. 

In the second part of his study, Standlee 
administered the same tests to his psychotic 
Ss approximately eight hours after their re- 
ceiving one electric shock. On the spiral re- 
test, he found two reporting incomplete after- 
effect perceptions with 23 reporting both 
expanding and contracting perceptions. In 
his retesting for evidence of memory impair- 
ment, he used the same form of the Wechsler 
Memory Scale as previously used and found 
the average MQ score for the group actually 
higher than before shock. On the basis of 
these data, he concluded that electric shock 
did not impair memory ability or the ability 
to experience the spiral aftereffect. 


This second part of Standlee’s study is also 
open to criticism. First, his results do show 
that electric shock had some effect on percep- 
tion of the aftereffect since two of his post- 
shock Ss reported incomplete perceptions, and 
it is open to question as to how many of the 
other twenty-three drew upon or utilized their 
previous experience with the test in giving 
their reports on retesting. Practice effect may 
have been operative here as well as elsewhere. 
Second, use of a single shock likely had mini- 
mal effects. Had more been used, results 
would likely have been more marked as has 
been shown by other studies (4, 8). Third, 
as he himself admits, the use of the same 
form of the Wechsler Memory Scale for evi- 
dence of impairment is faulty because of prac- 
tice effects, thus leaving him with no ade- 
quate criterion of memory impairment. His 
study would have fared better had he used 
in his postshock testing Form II which 1s 
available and which was used effectively by 
Stone (8). 

While we did not set out to verify the re- 
lationship between memory impairment and 
the spiral aftereffect, our findings and con- 
clusions, for reasons stated above, are more 
in agreement with those present in the study 
of Freeman and Josey than those of Standlee. 
We are in agreement with Standlee’s study 
insofar as we both found psychotic Ss—ours 
specifically diagnosed as functional or non- 
organic—as being able to perceive the after- 
effect. His study, however, did not deal ade- 
quately with the impairment factor which 
may be of organic or of functional origin. If 
impairment exists and if it is of organic 
origin, we predict difficulty or inability to 
perceive the spiral aftereffect. 

In summary, our data for the organic cases 
contrasted significantly with the nonorganic 
in the direction of expectancy. When failure 
to perceive the aftereffect is found, it is al- 
most certain that cortical involvement exists. 

The explanation of our significant results in 
psychophysical terms has not yet been worked 
out or established. Some leads may be found 
in Saucer’s article on processes of motion per- 
ception (5) and in Shapiro’s investigation on 
perception of apparent motion (6). Saucer is 
inclined to believe that motion perception is 
derived from a higher-level integrating or 
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synthesizing process in the central nervous 
system, this integrating or synthesizing proc- 
ess appearing to be adversely affected or non- 
existent in individuals with organic brain in- 
volvement. Shapiro believes that the percep- 
tion of apparent motion is related to an “ir- 
radiation of excitatory effects” (6,.p. 58) 
and that there is “an exaggeration of inhibi- 
tory effects in brain damaged patients” (6, 
p. 67) which weakens or destroys motion per- 
ception. While adequate explanation of the 
phenomenon remains to be hypothesized and 
verified, the results are such as to justify 
present clinical use of this technique in diag- 
nosis of organicity. 


Conclusion 


Organic cases with cortical involvement can 
be differentiated from nonorganic with high 
degree of certainty by means of the spiral 
aftereffect technique. 


Received November 19, 1954. 
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The Efficacy of Diagnostic Pattern Analysis 
with the Wechsler-Bellevue™ 


Jacob Cohen 
VA Hospital, Montrose, New York and City College, New York 


Since the publication of the revised manual 
for the Wechsler-Bellevue scales (5), and 
more particularly, since the publication of 
the Menninger group (4), clinicians have at- 
tempted to draw inferences about personality 
and clinical diagnosis from the intersubtest 
differences of Wechsler-Bellevue records. This 
practice, variously referred to as pattern 
analysis, scatter analysis, and profile analy- 
sis, has many enthusiastic proponents in the 
clinical field. It has developed, in a remark- 
ably short time, an enormous research litera- 
ture with results which have been character- 
ized by Magaret as “negative, conflicting, or 
questionable” (3, p. 370). 

The evidence for the validity of pattern 
analysis comes mainly from researches in 
which the scores of criterion groups of pa- 
tients are compared with those of controls, 
subtest by subtest. Significant differences dis- 
covered by ¢ test are harvested and are then 
offered as differentially diagnostic signs. 

The evidence against the validity of pat- 
tern analysis comes from several kinds of in- 
vestigations: (@) subtest-by-subtest compari- 
sons like those cited above which have failed 
to produce significant differences; (b) appli- 
cations of previously adduced patterns or 
signs on new samples with failure to sub- 
stantiate them; (c) reworking of data previ- 
ously offered as indicative of differentiating 
patterns to demonstrate that, in fact, no such 
patterns exist. 

1 From the Clinical Psychology Section, Neuropsy- 
chiatric Service, Veterans Administration Hospital, 
Bronx, New York. 

2 The author wishes to acknowledge the coopera- 
tion of Dr. H. L. Flowers, Chief Psychiatrist, and 
Dr. Robert S. Morrow, Chief Clinical Psychologist, 
of Bronx VA Hospital. He also appreciates the ef- 


forts of the seven clinical psychologists who served 
as subjects. 


The approaches of the researches described 
to the problem under question are indirect. 
The presence of significant differences be- 
tween groups on some subtests is no guarantee 
either that the matching of the groups has 
been complete enough to remove the effects 
of extraneous variables, or that these differ- 
ences are large enough to lead to fruitful ap- 
plications on individual cases. The absence of 
significant mean differences does not preclude 
the possibility that two obverse patterns, 
either of which is identifiable by a clinician 
as pertaining to a single diagnostic group, 
may not cancel each other out and lead to 
differences which fail of significance. Witten- 
born’s (6) demonstration with Rapaport’s 
data that pattern correlations within diag- 
nostic groups are no larger than those be- 
tween diagnostic groups—in the present au- 
thor’s opinion the clearest and most definitive 
attack on the problem—still leaves a logical 
loophole in that the clinician may differently 
interpret the same pattern when the level of 
the constituent scores varies. In all prob- 
ability, this loophole does not loom very 
large from a practical viewpoint. Still, Wit- 
tenborn’s approach to the problem is an in- 
direct one. 


The Problem 


When directly stated, the question which is 
basically at issue is, “Can experienced clini- 
cians, using only the Wechsler-Bellevue sub- 
test weighted scores and the verbal, perform- 
ance, and full-scale IQ’s, make nosological 
diagnoses of individuals which are signifi- 
cantly related to neuropsychiatric criterion 
diagnoses?” If they can, a second question of 
degree of agreement arises and is of practical 
importance. 
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Materials 


In the course of another investigation (1, 
2), Wechsler-Bellevue data (eleven subtest 
weighted scores and the three IQ’s) for 300 
successive admissions meeting research cri- 
teria were gathered. These data were made up 
of groups of 100 cases each of neuropsychi- 
atrically diagnosed psychoneurotics, schizo- 
phrenics, and brain-damaged patients. These 
were all white male veterans, aged 20 to 40, 
with unambiguous diagnoses which classified 
a patient into one and only one of the above 
three nosological groupings. The three groups 
were equated for mean and standard devia- 
tion with regard to age, years of education, 
and full-scale IQ. The frequency of subcate- 
gories in each group and the means and 
standard deviations of full-scale IQ, age, and 
years of education are given in the report of 
the earlier investigation (2). 


Method 


Subjects. The subjects proper were seven 
clinical psychologists with from four to four- 
teen years of diagnostic experience with the 
Wechsler-Bellevue. Two of the subjects had 
published research on the Wechsler-Bellevue. 

Procedure. The 300 patterns were randomly 
ordered and submitted to each psychologist 
individually with the request to classify each 
pattern as either psychoneurotic, schizo- 
phrenic, or brain-damaged. The subjects were 
informed that there were 100 of each but that 
they need not maintain this equality in their 
diagnoses. 

For each psychologist contingency tables 
were set up as follows: (a) A 3 xX 3 table 


Table 1 


Degree of Agreement Between Psychologist A’s 
Wechsler-Bellevue Pattern Diagnoses and Neuro- 
psychiatric Criterion Diagnoses for the Categories of 
Psychoneurotic, Schizophrenic, and Brain- Damaged 








Neuropsychiatric criterion 





Psycho- Schizo-  Brain- 
A’s diagnoses neurotic phrenic damaged Total 





Psychoneurotic 56 39 28 123 
Schizophrenic 24 33 29 86 
Brain-damaged 20 28 43 91 

Total 100 100 100 300 





Note.—x? = 20.11, df = 4, p < 001, Ce = 31. 
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Table 2 


Degree of Agreement Between Psychologist A’s 
Wechsler-Bellevue Pattern Diagnoses and Neuro- 
psychiatric Criterion Diagnoses in Discriminating 
Psychoneurotics 








Neuropsychiatric criterion 











Psycho- 

A’s diagnoses neurotic Other Total 
Psychoneurotic 56 67 123 
Other 44 133 177 

Total 100 200 300 
Note.—x? = 13.95, df = 1, p < .001,@ = .22. 


was set up to determine the over-all non- 
chance accuracy of diagnosis between the 
psychologist’s diagnoses and the neuropsychi- 
atric criterion diagnoses. This type of evalua- 
tion is illustrated for one of the psychologists 
(A) in Table 1.* (8) To determine the non- 
chance accuracy of psychologist’s diagnoses 
with regard to each diagnostic group sepa- 
rately, 2 x 2 tables were set up which ef- 
fected a correlation between psychologist’s 
diagnoses and the criterion diagnoses for each 
group with the other two combined. Table 2 
illustrates this type of correlation for the psy- 
choneurotic group utilizing the diagnoses of 
Psychologist A. (c) To determine the degree 
of relationship between pattern and criterion 
diagnoses, where chi square was significant, 
the corrected contingency coefficient was com- 
puted for the 3 x 3 table and phi coefficients 
for the 2 x 2 tables. 


Results 


Table 3 gives the results of the chi-square 
tests for the seven psychologists in terms of 
chi-square values. The first column of the chi- 
square values pertains to the 3 x 3 tests for 
each psychologist. The second, third, and 
fourth columns refer to 2 X 2 tests for psy- 
choneurotics versus other, schizophrenics ver- 
sus other, and brain-damaged patients versus 
other, respectively. 

8 Psychologist A was selected for use as an example 
of how the chi-square tests were performed. His was 
the most successful performance, and the reader 
would be seriously misled if he thought him typical. 
On the contrary, his attempt at prediction illustrates 
the inadequacy from a practical viewpoint of even 


the best performance in this group of experienced 
clinicians. 
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Table 3 


Chi-Square Values of Significance of Contingency Between Psychologist’s Wechsler-Bellevue Pattern 








Psycho- 
neurotics 
Psychologist 3x3 vs. other 
A 20.11** 13.95** 
B 21.18**t 2.11 
+ 8.44 36 
D 2.41 52 
E 6.74 19 
F 1.20 .06 
G 4.54 75 








* 05 >p > 02 
™* > < 001 
+t Reflects in part some sncorrectness. 


Table 3 immediately indicates that Psy- 
chologists D, E, F, and G failed to agree with 
the neuropsychiatric criterion to an extent 
greater than chance expectation. This holds 
for both the over-all (3 * 3) contingency as 
well as for the treatment of the three groups 
separately (2 X 2). 

Psychologist A, with 132 “correct” diag- 
noses (chance expectancy is 100 “correct”) 
showed extra-chance agreement with the neu- 
ropsychiatric criterion in the over-all analy- 
sis (p < .001). In addition, he discriminated 
psychoneurotics from others and brain-dam- 
aged from others significantly (p < .001). 

Lest the reader be overly impressed by the 
magnitude of the chi-square value and its 
high order of significance, stress should be 
placed on its exact meaning. It indicates that 
one can be quite confident that the hypothesis 
of no association is false; it does mot mean 
that the degree of association is strong. The 
contingency coefficient for the 3 xX 3 test for 
Psychologist A, corrected for the number of 
categories, was .31. For the psychoneurotic 
vs. other and brain-damaged vs. other asso- 
ciations, A’s phi coefficients were, respectively, 
.22 and .19. This obviously leaves much io 
be desired in the way of accuracy. 

Psychologist B’s results may be misleading. 
Although the over-all contingency is very sig- 
nificant (p < .001), part of this large chi- 
square value is attributable to the fact that 
the number of “correct” diagnoses for schizo- 
phrenics is below chance expectancy. This 
discrepancy adds to the value of the chi 
square but, of course, detracts from the over- 


Diagnoses and Neuropsychiatric Criterion Diagnoses 


2X2 
Schizo Brain 
phrenics damaged Number 
vs. other vs. other “correct” 
1.38 11.38** 132 
1.98 14.52** 115 
2.33 5.13* 117 
57 1.92 111 
O01 19 107 
1.05 07 94 
03 1.47 102 


all correctness of the diagnoses. This is evi- 
dent from the fact that he has a total of only 
115 “correct” diagnoses, which is not signifi- 
cantly better than chance. 

This is a good point at which to emphasize 
the fact that chi square measures the degree 
of departure of a set of empirical frequencies 
from some hypothetical set, and does not dis- 
tinguish the direction of departure. When the 
hypothetical set of frequencies reflects the 
hypothesis of a chance association (the null 
hypothesis), departures in both directions, 
i.e., both less than chance and in excess of 
chance, equally increase the chi-square value. 
It is therefore necessary, when using this 
method, to carefully scrutinize the contin- 
gency table cell by cell, before concluding 
that a significant chi 
than chance prediction. 

Psychologist B does identify brain-dam- 
aged patients with above chance success 
(p < .001), but with a small degree of re- 
lationship, i.e., phi = .22. 

Psychologist C, with 117 “correct” diag- 
noses, does not attain better than chance 
agreement with the criterion in the over-all 
comparison. However, he, too, identifies brain- 
damaged patients with better than chance 
success (p < .05), but with a phi coefficient 
of only .13. 


square means better 


Discussion 


If the theoretical question is posed, “Is 
there any detectable association between a 
neuropsychiatric diagnostic criterion and diag- 
noses made from patterns?” the answer must 
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be in the affirmative. If the results of the less 
ambiguous 2 X 2 tests are considered it can 
be seen that four of these are significant, 
three of them at the .001 level. This result is 
unlikely to be accounted for by chance alone. 
It is also unlikely to be a chance phenomenon 
that three of these four significant relation- 
ships occurred with regard to the brain-dam- 
aged group, or that of the seven psycholo- 
gists, three could significantly discriminate 
brain-damaged patients from others, while 
only one succeeded with the psychoneurotics 
and none with the schizophrenics. The con- 
clusion that some experienced psychologists 
can make diagnoses from Wechsler-Bellevue 
patterns significantly better than chance is 
inescapable. It is also likely that the success 
they enjoy comes largely from the ability to 
discriminate significantly brain-damaged pa- 
tients from others. This is the positive side 
of the picture. 

If a more practical question were posed, 
namely, “How useful are Wechsler-Bellevue 
patterns for neuropsychiatric diagnosis?” the 
answer, on the basis of the present results, 
must be, “Not very.” Four of the seven psy- 
chologists did not fare better than chance; 
indeed, one of them fell below mean chance 
expectancy. The most successful subject, A, 
made only 132 “correct” diagnoses out of the 
300, and thus was correct 43 per cent of the 
time, not quite 10 per cent more than the 
33% per cent expected by chance. If due al- 
lowance is made for the 100 “correct” chance 
diagnoses, then this psychologist made 32 
nonchance “correct” diagnoses for the re- 
maining 200 cases and can be credited with 
correctly diagnosing 16 per cent of the cases 
on a nonchance basis. 

The small degree of predictive accuracy is 
also apparent from the magnitude of meas- 
ures of relationship employed. The best of 
these, a corrected contingency coefficient of 
.31 for A’s 3 X 3 contingency, presents prob- 
lems in interpretation, but is in any event 
quite low. The phi coefficient, which is a 
product-moment coefficient and hence inter- 
pretable approximately as would be a Pearson 
r, gave values ranging from .13 to .22 in the 
four instances of better-than-chance associa- 
tion. 

That Wechsler-Bellevue pattern analysis 
cannot serve as a sufficiently valid independ- 
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ent diagnostic technique is so obvious that it 
is not worthy of comment. The data suggest, 
however, that even as a supplementary diag- 
nostic aid it is of questionable value. For 
many psychologists (four out of the seven 
well-qualified subjects of the present investi- 
gation), impressions derived from the pattern 
should be given no weight in the diagnostic 
decision. For some, it should play so small a 
role as to be of little consequence. 


Summary 


Seven experienced clinical psychologists at- 
tempted to diagnose the Wechsler-Bellevue 
patterns of 300 neuropsychiatrically diag- 
nosed veteran male patients as psychoneu- 
rotic, schizophrenic, or brain-damaged. Using 
neuropsychiatric diagnoses as criteria, it was 
found that only one clinical psychologist cor- 
rectly diagnosed a significant number of these 
300 patients, and only two others had extra- 
chance success in the diagnosis of a single 
diagnostic group (in both cases, the brain- 
damaged group). The actual rate of success, 
however, ranged in correlational terms from 
.13 to .22 and was deemed far too small to 
be of use clinically. 

It is concluded that although there is some 
nonchance relationship between Wechsler- 
Bellevue pattern and neuropsychiatric diag- 
nosis, it is detectable for only some clinicians 
and then only to so small a degree as to be of 
little practical utility. 


Received December 16, 1954. 
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Many investigators have found marked in- 
dividual differences in the form of the mental 
growth curve when each individual’s intelli- 
gence quotients or mental ages are plotted 
over a period of years.* Cycles of slow or 
rapid mental growth covering periods of long 
duration appear to be characteristic of large 
numbers of children from preschool years to 
adolescence. The consistency and magnitude 
of the trends of change in mental growth rate, 
repeatedly found in longitudinal studies (3, 
4, 5, 6, 8, 10), indicate that these changes 
are not due to statistical artifacts. To date, 
the factors which contribute to accelerative 
and decelerative changes in mental growth 
rate have not been clearly defined. 

In the study presented here we have in- 
vestigated whether groups showing acceler- 
ated trends, decelerated trends, or little 
change in mental growth rate differ in their 
ability to pass the different types of Stanford- 
Binet items. Insofar as individual items of 
the Stanford-Binet require somewhat different 
abilities for their solutions, differences among 
groups in item difficulty provide information 
about group differences in areas of specific 
ability. The items of the Stanford-Binet have 


1 Presented in part at the Annual Meeting of the 
American Psychological Association, New York, Sep- 
tember 1954. 

2The authors gratefully acknowledge the many 
helpful suggestions of Dr. John I. Lacey and the 
statistical assistance of Mrs. Josephine D. Lubing. 

8 When one refers to measures of gain or loss in 
IQ trends over long periods of time this is equiva- 
lent to referring to measures of accelerative or de- 
celerative changes in mental growth rate. Whether 
one chooses to graph IQ’s or MA’s is purely a mat- 
ter of whether one prefers constancy to be repre- 
sented by a straight line or by the diagonal line 
y =x. Accelerative and decelerative changes are de- 
picted relative to the line which is chosen to repre- 
Sent constancy. 


often been used in this diagnostic way. Mc- 
Nemar (9) suggested that groups of .certain 
items could provide rough estimates of ability 
in nonverbal, memory, 
of items. 

Information regarding the group differences 
in ability to pass different types of items is 
also useful in determining the importance of 
a test-construction artifact in IQ changes over 
long periods of time. Since the Binet test in- 
cludes more so-called nonverbal or perform- 
ance type items at preschool levels and con- 
tains more verbal items at later ages, children 
with greater verbal ability could presumably 
score lower at earlier ages and higher at later 
ages as a function of the changing composition 
of the test itself, while the converse could be 
true of children whose best abilities were in 
the nonverbal area. This hypothesis has some- 
times been given to account for the 
stancy of the IQ and the low predictive value 


and vocabulary types 


incon- 


of early tests (1, p. 294; 7, p. 643). 
Procedure 
The data for 140 children from the Fels 


Research Institute longitudinal study were 
used in the present analysis. Fifty-eight of 
the Fels subjects (Ss) admitted relatively 
early in the program received the 1916 Re- 
vised Stanford-Binet test at birthdays. from 
age 3 until age 6; while 82 Ss admitted to the 
program in later years received Form L or 
Form M of the 1937 Revision at birthdays 


and six months after birthdays from age 2! 


to age 6. From age 6 to 12 all 140 children 
received either Form L or Form M at birth- 
days. Form L and Form M were usually pre- 
sented alternately. With few exceptions the 
tests were administered within a few days of 
scheduled birthdays or half-birthdays, and 
were administered by one examiner through- 
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out the testing program. The mean IQ of the 
Fels children at any age is considerably above 
average on a variety of intelligence tests, the 
mean Stanford-Binet IQ for this sample be- 
ing near 120 at all ages with standard devia- 
tions varying from 14 to 20 IQ points (10). 

In order to divide the total group into ex- 
perimental groups of those with accelerative 
changes, decelerative changes and constant 
menta! growth rate trends, the following pro- 
cedure was used. A smoothed longitudinal IQ 
curve was prepared for each S by the method 
of moving averages. Prior to age 6 smoothing 
was done by obtaining the mean of blocks of 
three consecutive raw scores when the in- 
terval between tests was six months, and by 
blocks of two when the interval between tests 
was one year. After age 6, blocks of three 
raw scores were averaged, the interval be- 
tween tests being one year. The purpose of 
the smoothing was to eliminate erratic varia- 
tions and thereby effectively portray general 
trends of IQ change. The different forms of 
the test were not taken into account in aver- 
aging the raw scores. 

Quantification of the general trend in IQ 
change for each S was made in the following 
way. For the Ss who had been tested at 
yearly intervals prior to age 6 a “base IQ” 
was taken to be the mean IQ of raw score 
IQ’s obtained at ages 3 and 4. For those who 
had been tested at six-month intervals the 
“base IQ” consisted of the mean IQ of tests 
given at ages 21%, 3, and 3%. For each S the 
amount of change in IQ from the “base IQ” 
to the highest smoothed IQ (in the case of 
those with accelerated trends) or to the low- 
est smoothed IQ (for those with decelerated 
trends) was determined. This yielded a gain 
or loss amount relative to the “base IQ.” The 
Ss were then ranked from the individual 
gaining the most to the individual losing the 
most IQ points. The ranked sample of 140 
Ss was then divided into experimental groups. 

Group A consisted of the highest rank- 
ing 25 per cent of the sample, that is, those 
with greatest accelerative changes in mental 
growth rate. Group B, the 25 per cent of the 
sample who ranked in the middle of the 
distribution of ranks, was the group which 
showed least change; and group C was se- 
lected as the 25 per cent of the group who 


ranked as losing in IQ. It may be noted that 
only 75 per cent of the total sample was used. 
Approximately 13 per cent of the cases which 
ranked between group A and group B were 
eliminated from statistical treatment as were 
approximately 12 per cent of the cases rank- 
ing between groups B and C. These cases were 
discarded after graphic inspection of the in- 
dividual IQ curves showed that changes in 
mental growth rate in these two parts of the 
ranked distribution were more erratic than 
many of the cases falling into the other 
groups. 

The total sample was also subdivided in an- 
other dimension, being split into two matched 
groups (group I and II) of 70 each for pur- 
poses of cross-validation in this study and in 
future studies of these same Ss. Matching 
variables were date of birth, sex, level of IQ 
at age 3, and amount and direction of maxi- 
mum IQ change. Matching was accomplished 
in such a way that groups A, B, and C were 
subdivided approximately equally so that sta- 
tistical analysis of differences among groups 
Ay, By, and C; could readily be cross-vali- 
dated with groups Ay, By, and Cy. 

A system devised by Baldwin (2) was used 
for estimating difficulty in first passing items 
of the Stanford-Binet, Form L. The difficulty 
level for an individual in first passing an item 
was defined as the mental age halfway be- 
tween the mental age obtained by the indi- 
vidual at the time of his first success on the 
item and his mental age at the time of his 
previous failure on the same item. From this 
information about the difficulty of any item 
for each individual, it was possible to esti- 
mate the mean difficulty level of each item 
for the experimental groups. 

Statistical analysis consisted of F tests of 
the differences in mean difficulty level among 
the experimental groups. This item analysis 
was done for 60 items of Form L of the Re- 
vised Stanford-Binet, and consisted of all the 
items from the test level of year IV through 
the year-XII series of items. 


Results and Discussion 


Seven of the 60 F tests of differences among 
groups A;, B;, and C; were found to be sig- 
nificant below the .10 level in the first analy- 
sis. The seven items of the Stanford-Binet, 
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Form L, which resulted in these significant 
differences, were as follows: at year IV, items 
2 and 6; at year IV—6, items 1, 3, and 6; at 
year V, item 2; and at year VI, item 5. None 
of the differences on these same items were 
significant upon replication with groups An, 
By, and C;;. In the second analysis 30 F tests 
were run on those items which had the great- 
est differences in mean difficulty level between 
groups A;, B;, and C;. There were no trends 
toward significance between the first and sec- 
ond analysis. Since item difficulty was made 
relative to mental age, and therefore con- 
trolled for the effects of not only differential 
mental growth but also IQ level, it is con- 
cluded that there are no differences among 
the experimental groups in ability to pass dif- 
ferent types of items. In view of the negative 
results on Form L, no attempt was made to 
analyze the data from Form M. 

For the experimental purpose of this study 
it appeared to make no difference whether dif- 
ferent forms or form of the Stanford- 
Binet was used to obtain the smoothed trend 
line of IQ change. Smoothed IQ curves based 
on Form-L IQ’s were prepared for those Ss 
who had received the 1937 Revision with 
Form L and Form M alternately presented. 
Using the procedure of ranking the individu- 
als according to amount of change from the 
“base IQ” resulted in the Ss being placed 
in the same experimental groups as before. 
Smoothed curves based on Form-M IQ’s only 
yielded similar results also. A comparison of 
the distributions of gains and losses was also 
made between those who had received the 
1916 Stanford-Binet during the preschool 
years and those who had received the 1937 
Revision throughout the testing period. There 
were no significant differences between these 
two groups in the mean amount of points 
gained or lost from the “base IQ” to the point 
of greatest divergence. 

The maximum number of Ss possible in 
each experimental group in the first analysis 
was 18. The use of the Baldwin technique in 
estimating item difficulty level resulted in loss 
of data in the analysis of some items below 
the VIl-year level of the test. Group A; was 
combined with group Ay, B; with By, and C,; 
with C,; for a nonreplicated design in testing 
two items when the number in one experi- 


one 
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mental group fell below 10. This analysis re- 
sulted in no significant differences in item 
difficulty. 


Conclusions 


Within the limitations of the sample and 
methods of this study it is concluded that 
there is no evidence of differences in ability 
to pass any type of Stanford-Binet item be- 
tween those who accelerate in mental growth 
rate and those who decelerate. Accelerative or 
decelerative change in mental growth rate, at 
least in higher levels of IQ, is apparently as- 
sociated with similar changes in growth rate 
in more specific areas of ability. There is no 
evidence that change in the rate of mental 
growth reflects a spurious gain or loss in 
IQ due to an artifact of test construction, 
wherein the ratio of verbal to nonverbal 
abilities changes with chronological age. These 
conclusions must, of course, be limited to the 
IQ level dealt with in this study. 

It would appear that the factors which are 
associated with individual differences in the 
mental growth curve are more likely those 
factors which influence learning in any situa- 
tion. Sontag and his associates (10) have pre- 
sented data on the mental growth careers of 
the Fels subjects, and have proposed various 
aspects of motivation as determining factors 
in IQ change. Further research in this area 
promises to contribute knowledge of those 
factors which determine the form of the in- 
dividual’s mental growth curve. 


Summary 


The major purpose of this study was to de- 
termine whether Ss with accelerative changes 
in mental growth rate differed from those with 
decelerative changes in any specific areas of 
ability, as measured by the difficulty in first 
passing items of the Revised Stanford-Binet 
Scale, Form L. Matched experimental groups 
were obtained from 140 Fels Ss of normal to 
very superior intelligence, who had been 
tested at regular intervals from age 21% to 
age 12. Cross-validation procedure was used 
in analyzing 60 items. There were no trends 
toward statistically significant differences be- 
tween the groups in this analysis. 

It is concluded that at least in the higher 
levels of intelligence, children with accelera- 
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tive changes in mental growth rate do not 
differ in any specific areas of intellectual 
ability from those with decelerative changes 
in mental growth rate. There was no evi- 
dence in this study to support a hypothesis 
that changes in Stanford-Binet IQ from the 
preschool years to later years are due to the 
changing ratio of verbal to nonverbal items 
in progressive age levels of the test. 


Received December 16, 1954. 
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Most theories which attempt to account di- 
rectly or indirectly for certain major phe- 
nomena of human behavior subscribe to a 
“unified” concept of personality. Such theo- 
ries assume a high degree of constancy in the 
manner in which people perceive and respond 
to various situations. However, the experi- 
mental evidence on which such theories are 
based is meager and of recent origin (9, 11, 
18). The experiment to be reported in this 
paper is, we hope, a contribution to the vali- 
dation of one of the basic tenets of such theo- 
ries of personality, namely, that a person will 
respond in a relatively constant manner to 
different perceptual situations. In addition, 
this study offers new opportunity to explore 
the mechanisms or processes which underlie 
responses to the Rorschach method as well as 
to show that it can be effectively used as an 
instrument for the study of perceptual proc- 
esses (2, 10, 14). 

The perceptual hypothesis to be investi- 
gated in this experiment is the following: A 
person who responds to one set of stimuli in 
a “rigid” or “flexible” manner will respond to 
other stimuli in a similar manner. While rec- 
ognizing the importance of understanding the 
motivation of behavior, we are, at the present 


1Juis study was supported in part by a research 
grant from the National Institutes of Mental Health 
of the National Institutes of Health, United States 
Public Health Service. 

These data were gathered under Air Force Con- 
tract Number 33(038)-13884 with the Department 
of Clinical Psychology, United States Air Force 
School of Aviation Medicine. 

We wish to express our appreciation to Dr. George 
A. Ulett for making the data available and for his 
helpful suggestions in preparation of this paper. 


time, more concerned with determining that 
there are characteristic perceptual “styles” or 
“attitudes” which remain constant from one 
situation to another. Demonstration of the 
latter is a necessary first step toward the 
study of motivation. 

In this study we are specifically concerned 
with the constancy of perceptual “flexibility” 
and “rigidity” from one ambiguous perceptual 
task to another. While well aware of the con- 
fusion surrounding the term “rigidity,” we be- 
lieve that it comes closer to describing one 
extreme of the process we have in mind than 
other less equivocal terms. By perceptual 
rigidity we mean that the person responds in 
a relatively restrictive or selective manner to 
environmental cues, as compared to the flexi- 
ble person who responds in a less restrictive 
and selective manner to these same cues. 
Clinically, this type of person is often charac- 
terized as constricted and one who finds it 
necessary to deal with his environment in an 
unusually guarded and stereotyped manner. 

The two perceptual tools utilized in this in- 
vestigation are the Rorschach method and a 
photic stimulation experiment. In evaluating 
data from the Rorschach, Fisher’s measure of 
“personality rigidity” was used (6). This 
measure is based on “. . . a variety of Ror- 
schach signs which clinically have been found 
to characterize persons who are habitually re- 
stricted and who find it necessary to deal 
with the environment with an unusual amount 
of guarded caution” (6, p. 9). We feel that 
this definition, at least in part, describes what 
we mean by perceptual rigidity. Fisher’s scale 
also has been found to be related to other 
measures of perceptual rigidity (1). 
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The second ambiguous perceptual situation 
was intermittent photic stimulation at various 
frequencies. In this experiment the subject 
was requested to report what he saw after 
stimulation at various frequencies ranging 
from 3 to 30 flashes per second. These sub- 
jective sensations were the data used in this 
study. 

In both tasks, the subject is asked to state 
what he experienced and what the stimulus 
material reminded him of or looked like. In 
both tasks the stimuli are ambiguous and 
permit a variety of responses. 

In studies utilizing intermittent photic 
stimulation, Ulett and associates (15) re- 
ported various subjective sensations experi- 
enced by subjects. The content of these sen- 
sations ranged from pure description of colors 
and geometric designs to organized illusions 
and three-dimensional perceptions. Some sub- 
jects reported feelings of being projected into 
space, spinning, dizziness, anxiety, nausea, or 
other marked dysphoric experiences. Ulett 
found that it was possible to discriminate 
fairly well between nonanxiety-prone and 
anxiety-prone individuals according to the 
kind of sensation experienced during photic 
stimulation. More feelings of dysphoria were 
reported by anxiety-prone individuals. 

As part of a larger study reported else- 
where (16), each subject was administered a 
Rorschach and his subjective sensations were 
recorded during intermittent photic stimula- 
tion. It was thus possible to obtain measures 
of perceptual rigidity for each task. Sub- 
stantiation of the hypothesis that rigidity on 
the Rorschach is related to response to photic 
stimulation will add further support to the 
growing belief of constancy of perceptual 
“styles,” as well as elicit new evidence that 
Rorschach responses reveal adaptive proc- 
esses which are not different in kind from 
those appearing in other situations. 


Subjects and Procedure 


Subjects were 117 male students drawn 
from the entering class of a local Protestant 
seminary. The age range of the group was 
from 18 to 26 with a median of 20. For each 
subject (a) a battery of psychological tests, 
including the Rorschach, was administered, 
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(6) an interview by two psychiatrists was 
given, and (c) an_ electroencephalogram 
(EEG) was recorded. Part of the EEG pro- 
cedure included a photic stimulation survey 
of 3-30 flashes per second. There was a 40- 
second exposure to each of 21 different fre- 
quencies. Photic stimulation was produced by 
a pendulum-type episcotister interrupting a 
tungsten-filament light source which projected 
a 30-inch circle of light of 200 foot-candles 
intensity on an opal glass screen placed di- 
rectly before the subject and filling his visual 
field. After each 40-second exposure, the sub- 
ject was asked what he had seen or experi- 
enced. His responses were recorded as nearly 
verbatim as possible. These verbalizations 
were the data used in this study. 

The psychological battery was the first pro- 
cedure in the research; thus the Rorschach 
always preceded exposure to photic stimula- 
tion by at least a day. All the Rorschachs 
were administered and scored by the same 
person, an intern psychologist receiving train- 
ing at Washington University School of 
Medicine after having completed all course 
requirements for the Ph.D. degree. The Klop- 
fer scoring system (12) was used except for 
scoring of form level and originals where 
Hertz’ (8) scores were used. 

The measures of perceptual rigidity. As 
mentioned above, Fisher’s rigidity scale was 
used as the measure of perceptual rigidity 
manifested in the Rorschach. The criteria for 
scoring the subjective sensations were a 
modification of those used by Klein and 
Schlesinger (10) in their study of perceptual 
attitudes toward instability. These criteria 
were developed and the subjective sensations 
were scored independently of the Rorschach 
measure of rigidity. The criteria used in this 
study were: 


1. Criteria for perceptually rigid group. 

a. Little verbalization; verbalization and elabora- 
tion does not increase as flicker frequency in- 
creases; verbalization may tend to decrease. 

b. Responses are detailed descriptions of stimulus, 
eg., geometric patterns or designs, lights, blocks, 
spots, circles, dots, squares, etc. 

c. Movement seen predominantly descriptive and 
related to stimulus, e.g., whirling, shimmering, 
coming and going, up and down, fluctuates, 
fades in and out. 
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d. Uses same percepts, either color, form, or mo- 
tion, and is not able to shift or elaborate on 
responses even when flicker frequency in- 
creases. 


=) 


2. Criteria for the flexible group. 

a. Much verbalization and elaboration which 
tends to increase as flicker frequency increases. 

6. Responses not stimulus bound nor descriptive 
in nature, allows self to project forms and ob- 
jects into stimulus. 

c. Movement seen also not stimulus bound nor 
predominantly descriptive, allows self freedom 
in expression and can take attitude of “dis- 
tance” from stimulus. 

d. Content not stereotyped, uses more than one 
type of percept, allows self freedom to elabo- 
rate and change responses as flicker frequency 
increases. 

Subjective sensations of each subject were 
judged as perceptually rigid or perceptually 
flexible by both authors and also were rated 
as to how well they met the criteria for that 
group. All ratings were made on a four-point 
scale of confidence extending from positive 
judgment that the subject falls into the given 
category to the feeling that the judgment was 
extremely tenuous. There was no fixed weight- 
ing procedure and it was rare that all the cri- 
teria for one group were met. The rating was 
in terms of the general over-all impression, 
and each judge was free to determine the im- 
portance of any one criterion. Disagreement 
between the two judges as to the group in 
which a subject should be placed eliminated 
the subject from the study. A difference of 
more than two points as to how well a sub- 
ject met the criteria for the group in which 
he was placed also eliminated the subject. 
Fifteen subjects were eliminated because of 
difference as to group placement, and twelve 
more were eliminated because of difference of 
more than two points in the rating of cer- 
tainty that the subject met the criteria. This 
reduced the N from 117 to 90. The over-all 
agreement between the two judges was 77 
per cent, agreement for group placement alone 
was 87 per cent. 

Fifty-six of our subjects were classified as 
rigid and thirty-four as flexible on the basis 
of their subjective sensation to photic stimu- 
lation. 

Results 


The results of the comparison of the ri- 
gidity score on the Rorschach and response 
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Table 1 
Comparisons of Response to Photic Stimulation and 


Rorschach Rigidity Score 


Rorschach rigidity score 


Photic stimulation N Mean SD CR p 
Perceptually rigid BL 0.7 679 «(0001 
Perceptually flexible 34 208 12.8 


to photic stimulation are presented in Table 1. 
These results clearly indicate that, in this 
sample, rigidity on the Rorschach is related 
to our measure of perceptual rigidity in re- 
sponse to photic stimulation. Those subjects 
who were placed in the perceptually rigid 
group in terms of their response to photi 
stimulation had significantly higher Ror 
schach rigidity scores. A biserial correlation 
was computed to obtain an estimate of the 
relationship between the two perceptual meas- 
ures. This correlation was .59. If a Fisher 
Rorschach Rigidity score of 25 is used as a 
cutting point, 
(24 per j 
in the perceptually rigid group. Fourteen of 
the perceptually rigid subjects (25 per cent) 


flexible 


incorrectly placed 


eight of the 


li 1e( ts 


cent) would be 


would be incorrectly labeled as perceptually 
flexible. 
On the task a signifi- 
cantly larger number of subjects fell into the 
perceptually rigid than into the flexible group 
(56 rigid, 34 flexible). Two explanations seem 
Two 


subD- 


photic stimulation 


probable. One, our criteria was at fault 
the larger number of perceptually rigid 
jects was a function of the photic stimulation 
task. Both probably are factors. Our criteria 
were a first attempt at such discrimination, 
and refinement is undoubtedly possible. How- 
ever, the most important factor seems to have 
been the general conditions under which our 
sample was subjected to the photic stimula- 
tion task. 

For most of these subjects it was their first 
trip to a neuropsychiatric hospital where the 
laboratory is located, and it probably was dis- 
concerting to have several needle electrodes 
stuck into one’s scalp for the first time. There 
was no structuring as to what would happen 
to them or what they should see during photic 
stimulation. Thus it is not surprising that 
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many of the subjects were apprehensive, and 
reluctant and guarded about expressing them- 
selves. Those able to express themselves freely 
are, perhaps, individuals who are able to 
adapt themselves to new and ambiguous 
situations. 

The Rorschach, on the other hand, was ad- 
ministered in a more familiar situation—at 
the seminary attended by these students. The 
rigidity scores on the Rorschach were nor- 
mally distributed, and the scores for both our 
perceptually rigid and flexible groups fall 
within one standard deviation of Fisher’s 
normal group. 


Comparison of Individual Rorschach Vari- 
ables 


To see which of the determinants were con- 
tributing most heavily to the differentiation 
between the two groups, a comparison of in- 
dividual Rorschach variables was made. Cron- 
bach (3) has pointed out many of the errors 
and pitfalls in such comparisons. Of particular 
importance is the positive relationship be- 
tween the number of responses (R) and a 
number of clinically important determinants. 
Because the number of responses were sig- 
nificantly different between our two groups 
(the perceptually flexible group gave more 


Table 2 


Comparison of Individual Rorschach Variables 











Mean scores 





Rorschach _— perceptually Chi 
variable Flexible Rigid square p Cc 
R 48.3 34.5 11.53 001 34 
#M 
(uncorrected 
for R) 4.62 2.28 20.79 001 44 
#M 
(corrected 
for R) 7.69 .008 .28 
#0 
(uncorrected 
for R) 10.2 6.1 10.76 .001 33 
#0 
(corrected 
for R) 027 NS — 
T/R oa” Sa8 17.80 001 Al 
T/1R 18.5 27.6 8.30 .006 .29 
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responses than the perceptually rigid group), 
the chi squares for number of movement 
(#M) and number of original responses 
(#0) are reported with and without correc- 
tions for R. The method of correction was 
that suggested by Cronbach (3, p. 411). As 
most of the distributions were skewed, chi- 
square measures of significance were com- 
puted. The median of the combined groups 
was used as the dividing point. A contingency 
coefficient was computed to give an estimate 
of the degree of association between the two 
groups for each variable. These correlations, 
of course, are not comparable to product- 
moment correlations and are limited by the 
number of categories, but their use does not 
include assumptions of normality or linearity. 

Of the 17 Rorschach variables for which 
chi squares were computed, five were signifi- 
cant beyond the .01 level as indicated in 
Table 2 (#R, #M corrected and uncor- 
rected for R, #O uncorrected for R, T/R, 
T/1R). Those not significant were W%, D%, 
Dr%, S%, F%, #FC, #CF+C, Sum C, 
#O corrected for R, #P, P% and variety of 
content. As O when corrected for R was not 
significant, the difference in number of origi- 
nal and variety of content responses seems to 
be a function of difference in R. 

These findings relate well to measures of 
personality rigidity used in the clinical evalua- 
tion of the Rorschach. Most Rorschach ex- 
perts would agree that restriction in number 
of responses, few movement responses, greater 
time per response and delayed reaction time 
are major signs utilized in the determination 
of personality rigidity. The number of origi- 
nal responses is also often used as an indi- 
cator of rigidity, and even though our flexible 
groups gave significantly more originals, the 
difference failed to be significant when cor- 
rected for R. 

The failure of F% and F + % to be sig- 
nificantly different in the two groups was sur- 
prising. F + % approached significance, p of 
.09, and was in the expected direction, but in 
light of the common use of F% and F + % 
as indicators of constriction and rigidity, we 
expected the difference to be larger. 

Because of the differing reports (3, 5, 13) 
on the relationship of M to R, a correlational 
scattergram was plotted and as the relation- 
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Table 3 


Comparison of Groups Using a Plus or Minus Scoring 
Procedure and Comparison of Individual 
Elements in the Fisher Scale 





Per cent plus scores 





Individual perceptually 
elements Flexible Rigid CR p 
All elements 33.9 43.2 2.67 008 
F% 41.1 46.4 49 — 
#R 3.0 19.6 2.26 .02* 
A% 8.8 5.4 51 —* 
F+% 35.3 55.4 1.66 06 
Color 52.9 57.1 39 — 
W 23.5 33.9 1.05 — 
Dd 38.2 42.9 A8 — 
M 17.6 51.8 3.23 001 
Content 76.5 64.3 1.22 — 
T/1R 23.5 35.7 1.22 — 
Shading responses 52.9 62.5 .90 
18.6 42.3 4.16 .0001 


#R+F+%+M 





* Corrected for continuity. 


ship between M and R was linear, a Pearson 
product-moment correlation was computed. 
The correlation was .50. The correlation be- 
tween #O and #R, similarly computed, was 
83. It is thus not surprising that our chi- 
square value for M should decrease from 
20.79 to 7.69, and from 10.76 to .027 for #O 
when corrected for R. These findings lend 
support to the findings of Fiske and Baugh- 
man (5) and indicate the importance of con- 
trolling R when using individual Rorschach 
determinants for comparative purposes. 


Analysis of Elements in Fisher’s Rorschach 
Scale 


The analysis of the individual Rorschach 
variables and inspection of the data suggested 
that all elements in Fisher’s Rorschach scale 
are not contributing equally to the total score, 
and that a differentiating measure of Ror- 
schach rigidity was possible by utilizing a 
simple plus or minus scoring procedure. In 
the usual procedure a weighted score is as- 
signed as a penalty for what is considered to 
be excess rigidity or restrictiveness. The larger 
the final summation of weights, the greater is 
the implied rigidity. In this present analysis, 
instead of assigning a weighted score, only a 
plus was given when a penalty score was indi- 
cated. When no penalty score was indicated, 
a minus was given. The individual elements 
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of the Fisher scale were similarly analyzed 
with the exception of card turning which was 
not scored because of incompleteness of data. 
The percentage of plus signs for each group, 
and the differences are given in Table 3. 

As expected, the over-all difference between 
the two groups is highly significant. Those 
classified as perceptually rigid on the basis of 
their response to photic stimulation have a 
significantly larger percentage of plus scores 
than do those labeled perceptually flexible. 
The results of the analysis of individual ele- 
ments are consistent with those found in the 
comparison of individual Rorschach variables. 
Human movement and number of responses 
were significant beyond the .05 level, and 
F+9% at the .06 level. While the other 
scores were not significantly different, the 
differences were in the expected direction 
with the exception of A% and content. The 
use of only #R, F + % and M in future re- 
search of this kind is suggested by the highly 
significant difference obtained when only these 
three elements are used for comparison. 


Relation of Perceptual Rigidity—Flexibility 
to Intelligence and Anxiety Proneness 


The results on the Rorschach suggest that 
the perceptually flexible group is possibly 
more intelligent than the perceptually rigid 
one, raising the possibility that the life styles 
in question are simply those of more or less 
intelligent students. To evaluate this possi- 
bility two measures of intelligence were uti- 
lized for comparison, ACE scores and a short 
form of the Wechsler-Bellevue (Comprehen- 
sion, Vocabulary and Similarities). The two 
groups did not differ significantly on either 
the group or individual test. The mean ACE 
score for the rigid group was 132.8 and 135.8 
for the flexible group. The mean CVS scores 
were 41.7 and 42.4 for the rigid and flexible 
groups, respectively. Thus the possibility that 
the style of behavior exhibited in these two 
perceptual situations is a function of intelli- 
gence is not supported. 

As the psychological tests and psychiatric 
interviews of which these data are a part were 
used extensively to judge anxiety proneness, 
a comparison between the anxiety-proneness 
score and our measures of rigidity-flexibility 
was possible. This seemed to be particularly 
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relevant since Ulett (16) has found this meas- 
ure of anxiety proneness to be related to feel- 
ings of dysphoria during photic stimulation 
and since there are some who think of per- 
ceptual rigidity as a result of anxiety or a de- 
fense against anxiety (4). 

Neither of the measures of perceptual ri- 
gidity-flexibility was significantly correlated 
with anxiety proneness as measured in the 
original study. The Pearson product-moment 
correlation between Fisher Rorschach rigidity 
score and anxiety proneness was .10, and the 
biserial correlation between ratings of per- 
ceptual rigidity-flexibility based on the sub- 
jective response to photic stimulation and 
anxiety proneness was .11. 

This low relationship raises new questions 
as to the relationship of rigidity-flexibility to 
anxiety. Many readers may draw the conclu- 
sion that the anxiety measure was inadequate. 
This cannot now be ruled out. However, the 
rating of anxiety that was used was based on 
a number of the commonly accepted psycho- 
logical measures of anxiety in use today. The 
Rorschach, Taylor Anxiety Scale, Saslow 
Screening Questionnaire, Digit Span, Mirror 
Drawing, Draw-A-Person, evaluation of gen- 
eral test behavior, and psychiatrists’ ratings 
all were utilized in evaluating anxiety prone- 
ness. 

Three other alternatives seem possible. 
First, the relationship between anxiety and 
perceptual rigidity is complex, that is, per- 
ceptual rigidity may be a successful defense 
against anxiety, and, therefore, some highly 
rigid individuals would show little or no anx- 
iety. It is interesting that Fisher found hys- 
terics and paranoids, two clinical groups who 
show the least manifest anxiety, to be the 
most rigid. Certainly this whole area of per- 
ceptual rigidity, supposedly the result of anx- 
iety, is poorly defined, unclear, and needs fur- 
ther study. 

A second alternative is that perceptual ri- 
gidity-flexibility is an “autonomous” or “con- 
flict-free” function of the ego as discussed by 
Hartman (7). That is, it is a function not ex- 
clusively or necessarily developed from or in 
the service of drive conflicts. Klein and his 
co-workers (11) believe that their results 
seem increasingly relevant to the above for- 
mulation. They state: “It seems a worth- 
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while hypothesis that those aspects of per- 
ceptual process which psychoanalytic theorists 
currently view as ‘autonomous’ are themselves 
idiosyncratically organized within people, i.e., 
into ‘styles of autonomous functioning’ ” (11, 
p. 3). 

A third alternative suggested by Gray Wal- 
ter’s work (17) is that the behavior exhibited 
is a resultant of physiological factors not yet 
determined rather than being a function of 
anxiety. He has reported that the onset of 
a particularly vivid illusion or hallucination 
during photic stimulation was preceded or ac- 
companied by a characteristic alteration in 
the electrical response of the brain. Emotional 
and autonomic disturbances were usually cor- 
related with augmented response at 6—7 cycles 
per second from the parieto-tempora! region. 
The use of electronically analyzed EEG rec- 
ords during photic stimulation may help in 
indicating the association of subjective sen- 
sations to electrical discharge in the brain 
even though no cause-and-effect relationship 
can be inferred at this time. Further work is 
in progress in this area. 


Summary and Conclusion 


The results of this study add new evidence 
to the growing belief that there are “percep- 
tual styles” or “perceptual attitudes” which 
are consistent modes of response, and that the 
Rorschach method can be used effectively as 
a perceptual instrument in the study of per- 
sonality. We have shown that individuals who 
respond in a perceptually rigid manner in one 
perceptual task will respond in a like manner 
to a different perceptual situation. The one 
factor which both tasks have in common is 
that they are ambiguous perceptual situations. 
The hypothesis was proposed that individuals 
respond in a relatively consistent manner to 
environmental cues, and two perceptual tasks 
were utilized to test this. We further hy- 
pothesized that the Rorschach method could 
be used as a tool for the study of perception 
and that Rorschach responses would reveal 
adaptive processes not different in kind from 
those appearing in other perceptually am- 
biguous situations. To test the hypotheses we 
utilized data collected on 117 freshman stu- 
dents from a local seminary. These students 
were given the Rorschach, and their sub- 
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jective sensations during intermittent photic 
stimulation were recorded. The subjective sen- 
sations were used for comparison with Ror- 
schach responses. 

The Rorschachs were scored for rigidity ac- 
cording to the technique developed by Fisher. 
The subjective sensations were scored inde- 
pendently utilizing an a priori criterion for 
dividing the sample into two groups, percep- 
tually rigid and perceptually flexible. 

The perceptually flexible group had signifi- 
cantly lower Rorschach rigidity scores than 
did the perceptually rigid group. When the in- 
dividual Rorschach determinants were ex- 
amined, the perceptually flexible group was 
found to have given significantly more re- 
sponses, more movement responses, taken less 
time per response, and had a significantly 
lower average reaction time. In contrast to 
findings reported to date, F% and F + % 
did not significantly differentiate the two 
groups. Neither of the two perceptual rigidity- 
flexibility measures was related to intelligence- 
test scores or to a measure of anxiety prone- 
ness. The significance of these findings is dis- 
cussed and alternative hypotheses are sug- 
gested. 


Received January 6, 1955. 
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Allport, G. W. Becoming: basic considerations for a 
psychology of personality. New Haven, Conn.: 
Yale Univer. Press, 1955. Pp. ix + 106. $2.75. 
Revised from Yale’s Terry Lectures, which chal- 

lenge the lecturer to relate his specialty to human 

welfare and to a broad conception of religion, this 

little book is a quietly bold attempt to present a 

perspective in psychology on such matters as free- 

dom, the religious sentiments, and the democratic 
ideal. The unifying concept is that of personality, 
taken as something continuously becoming rather 
than ever meaningfully identifiable on cross-sectional 
analysis. Personal uniqueness, selfhood, and auton- 
omy, familiar Allportian principies, play their pre- 
dictable roles in the emphasis on the person as the 
growing and evolving unit of psychological interest. 
Finally, psychology’s prime task is conceived as that 
of determining whether “the democratic ideal is 
viable.” Read as an impressively learned and even 
poetically sensitive statement of a possible relation- 
ship between psychological science and certain vital 
human values, Becoming provides a profiable ex- 
perience for any psychologist concerned about either 
his discipline or his status as an intellectual in the 
republic’s citizenry. Similarly, Allport’s insistence on 
the process character of personality is useful and 
welcome. One may wonder, however, if such bor- 
rowings as Swedenborg’s concept of the proprium is 
not evidence for a flirting with reification in the 
ideas of personality and the self, and if the avowed 
acceptance of Leibnitzian idealism has not led to a 
kind of stubborn misunderstanding of both psycho- 
analysis and neobehaviorism. Both seem to serve 
only as convenient but ghostly whipping boys. Even 
among those who share Allport’s values and admire 
his humanity, there is still room to doubt that his 
methodological point of view does other than inhibit 
the kinds of understandings for which he argues 
so urgently and with such cultivated persuasion.— 
EZ. J. 3. 


Arieti, Silvano. Interpretation of schizophrenia. New 
York: Robert Brunner, 1955. Pp. xxiii + 522. $6.75. 
In spite of the author’s modest disclaimers, Jnter- 

pretation of Schizophrenia is a thorough, systematic 

treatment, and about as complete as a single volume 





Note—The reviews were prepared by the Editor 
and the Advisory Editors, who may be identified by 
their initials. 


on so vast a subject can be expected to be. Dr. Arieti 
proceeds logically from a historical development to 
psychodynamics, through a study of formal mecha- 
nisms in schizophrenia, to discussions of progressive 
stages of the disease, the organic manifestations, and 
methods of treatment. The point of view is dy- 
namic without an underestimation of somatic fac- 
tors. Of special interest to psychologists are chap- 
ters on “The Retreat from Emotions,” “The Retreat 
of Reason,” and “The Retreat from Sanity,” to single 
out only three of the twenty-four excellent chapters. 
The book is well-written and reads easily; case dis- 
cussions are few but rather full, although illustrative 
behavior samples abound; a bibliography of 280 
titles is listed. It is an important reference work as 
well as a balanced text on schizophrenia—M. K. 


lum, Lucille H., Davidson, Helen H., & Fieldsteel, 

Nina D. A Rorschach workbook. New York: In- 

ternational Universities Press, 1954. Pp. 166 (pa- 

per). $2.00. 

This lithographed paper-bound volume introduces 
the student to each of Klopfer’s major scoring de- 
terminants and provides an extensive series of scor- 
ing exercises for each. The “correct” answers are 
provided in an Appendix. A brief final chapter is 
devoted to administration with special attention to 
the inquiry as an essential prerequisite to accurate 
scoring. Neither the text nor the exercises are con- 
cerned with interpretation, which in the authors’ 
opinion should follow the development of skill in 
scoring. The “basic bibliography on scoring” has 
seven titles—EZ. L. K. 


Patrick, Catharine. What is creative thinking? New 
York: Philosophical Library, 1955. Pp. xi+ 210. 
$3.00. 

This is an amalgam of well-known publications on 
creative thinking, with selected materials on reason- 
ing. Included also are a chapter on age and produc- 
tivity and a program for improving creative think- 
ing. The quotations and data are organized around 
stages of preparation, incubation, illumination, and 
revision or verification. There is a comprehensive 
bibliography. —A. R. 


Rose, Arnold M. (Ed.) Mental health and mental 
disorder, a sociological approach. New York: Nor- 
ton, 1955. Pp. xiv + 626. $6.50. 

This volume is the first of a projected series to be 
published under the auspices of the Society for the 
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New Books and Tests 


Study of Social Problems, an interdisciplinary group 
concerned with the integration of sociological, psy- 
chological, and anthropological research and the ap- 
plication of these researches to human problems. It 
contains a collection of thirty-eight essays, case 
studies, research reports, and systematic analyses of 
the literature, planned to give an overview of the 
rather scattered materials in the field. Ten of the 
papers were prepared especially for the volume; the 
others have appeared previously, chiefly in socio- 
logical journals. The papers are presented in seven 
groups, the titles of which indicate the wide scope: 
problems of social psychiatry and theoretical over- 
view, social characteristics of the mentally disor- 
dered, mental disorder in the community, sociologi- 
cal approaches to the study of specific disorders, 
social psychology of personality organization and 
disorganization, the sociological approach to prob- 
lems marginal to mental disorder, and contributions 
to the understanding of mental health. The survey 
may be useful to psychologists. It concentrates a 
considerable amount of data and discussion, and 
most of the papers have extensive bibliographies — 
A. R. 


Royce, James E. Personality and mental health. 
Milwaukee, Wis.: Bruce, 1955. Pp. xiv + 352. 
$3.50. 


This brief survey of modern clinical psychology is 
scholastic in viewpoint and “integrated throughout 
with a frankly Christian philosophy of life.” The 
author planned his basic text in mental hygiene and 
the psychology of adjustment with reference to the 
problems of students. He therefore did not attempt 
to include references on all the material or on the 
various areas, but gave emphasis to classroom situa- 
tions and students’ needs.—B. M. L. 


Ulett, George. Rorschach introductory manual. Bev- 
erly Hills, Calif.: Western Psychological Services, 
1955. Pp. 45 (paper). $3.50. 

This is the second edition of a manual first pub- 
lished in 1949 as an aid in teaching the Rorschach 
technique to physicians. It is an attractively printed 
lithographed booklet, covering the essentials of ad- 
ministration, scoring, and interpretation. Included 
also are a percentage calculation table, an ingenious 
multicolored “Interpretation Chart,” and a table of 
“signs” to aid in clinical diagnosis. The approach is 
eclectic, and the text, while didactic, is extremely 
lucid. The first sentence in the text states: “The 
Rorschach test is a remarkably accurate means of 
gaining information about a patient’s personality 

.”; later, in the chapter on interpretation, the 
author warns that “some of the Rorschach theory 
and interpretation given in the following pages are 
still open to question.” There is a selected bibli- 

ography of 61 titles—Z. L. K. 
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Tests 


Holzinger, Karl J., & Crowder, Norman A. Hol- 

singer-Crowder Uni-Factor Tests. Grades 7-12. 

2 forms. 40% (90) min. IBM or hand scoring. 

Test booklets ($5.70 per 35) with manual, pp. 30; 

2 answer sheets ($1.80 per 35, and $1.15 per 35); 

keys (50¢); specimen set (50¢). Yonkers, N. Y.: 

World Book Co., 1955. 

The Uni-Factor Tests consist of nine subtests which 
measure four factors: verbal, spatial, numerical, and 
reasoning. Each factor is scored separately, and in- 
terpreted by the aid of percentile tables which give 
norms for each grade from 7 to 12. In addition, a 
Scholastic Aptitude Score may be obtained from a 
simple regression equation which combines’ the 
verbal, numerical, and reasoning factor scores. Al- 
ternate-form and split-half reliabilities for the sepa- 
rate factors compare favorably with other similar in- 
struments. Typical intercorrelations among the fac- 
tors, for single-grade groups, range from about .30 
to about .50, and show that the scores, while not 
independent, possess considerable distinctiveness. The 
Manual contains unusually full data on the relation- 
ships of the factors to other concurrent measures— 
other intelligence tests, achievement tests, and school 
marks. In these data, differential values of the fac- 
tors are evident. Although the ultimate merit of the 
test in predicting academic and vocational criteria 
remains to be determined, it represents one more 
thoughtfully constructed tool for analyzing “global 
intelligence” into some meaningful parts—L. F. S. 


Wechsler, David. Wechsler Adult Intelligence Scale 
(WAIS). Ages 16 and above. Individual test. 1 
form. Test material, with 25 record forms, and 
manual, pp. vi+ 110 ($21.00); record form only 
($1.60 per 25); manual only ($2.75). New York: 
Psychological Corp., 1955. 


The long-awaited revision of the Wechsler scale 
will fulfill the demands of psychologists—it is enough 
of a revision to remedy the major shortcomings of 
the 1939 Wechsler-Bellevue, and not so sweeping a 
change as to discard the experience gained by cli- 
nicians from the use of the older test. The eleven 
subtests remain the same, but all except the Digit 
Span have been revised in some degree. The Vo- 
cabulary subtest is wholly new; troublesome and 
outdated items have been removed from Informa- 
tion, Comprehension, and Arithmetic, and the Ob- 
ject Assembly has been lengthened by adding an- 
other object, an elephant. The major standardization 
from ages 16 to 64 was based on 1,700 examinees 
with equal numbers of men and women, and with a 
precise stratification of geographical region, urban- 
rural residence, race, and occupation based on the 
1950 census. The manual contains appropriate data 
on reliabilities and subtest intercorrelations for three 
age segments. Corrected split-half reliabilities are .97 
for the full scale and range from .66 to .96 for the 
subtests. The manual and record blank both warn 
against making clinical interpretations from profiles 
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or from differences between subtest scores with lim- 
ited reliability, Left for future research, perhaps 
quite properly, are the relationships between the old 
and new scales, and the validities of the revised test 
for various applications. The test itself and the data 
in the manual give the impression that the WAIS is 
a mature and sophisticated instrument, a worthy 
successor to the Wechsler-Bellevue for both clinical 
service and research.—L. F. S. 


Wittenborn, J. Richard. Wittenborn Psychiatric Rat- 
ing Scales. Psychiatric patients. Individual rating 
scale. 1 form. Rating scales ($2.75 per 25); with 
manual, pp. 12; specimen set (35¢). New York: 
Psychological Corp., 1955. 


A series of 18 research articles since 1950 has re- 
ported the development and application of the Wit- 
tenborn scales. Now they are made available for gen- 
eral use in an attractive and convenient format. The 
scales are an aid to the objective description of psy- 
chiatric patients in terms of their observable symp- 
toms. On each of 52 areas of behavior, a patient is 
rated by selecting the one of four statements which 
describes him best. The quantified ratings are turned 
into scores on nine factors identified by factor ana- 
lytic studies. The corrected split-half reliabilities of 
the factor scores range from .67 to .92, with only 
one scale below .76; their intercorrelations are gen- 
erally low. The new blank greatly simplifies the 
calculation of the factor scores by reducing it to the 
addition of digits in conveniently arranged columns 
and the use of a simple table. With their new con- 
venience and availability, the scales will probably 
receive wider use in research. They make a valuable 
contribution to the knottiest problem in studies of 
psychopathology, the problem of the criterion — 
L. F..3- 


Books Received 


Bettelheim, Bruno. Truants from life. Glencoe, IIL: 
Free Press, 1955. Pp. xvi+ 511. $6.00. 

Bram, Joseph. Language and society. Doubleday 
Short Studies in Sociology, No. 8. Garden City, 
N. Y.: Doubleday, 1955. Pp. viii+66 (paper). 
95¢. 

Chinoy, Ely. Automobile workers and the American 
dream. Garden City, N. Y.: Doubleday, 1955. Pp. 
xx + 139. $3.00. 

Deutsch, Felix, & Murphy, William F. The clinical 
interview. Vol. Il: Therapy. New York: Interna- 
tional Universities Press, 1955. Pp. 335. $7.50. 

Faris, Robert E. L. Social disorganization. (2nd Ed.) 
New York: Ronald, 1955. Pp. viii + 664. $5.50. 

Frank, Lawrence K. Individual development. Dou- 
bleday Papers in Psychology, No. 14. Garden 
City, N. Y.: Doubleday, 1955. Pp. vii+52 (pa- 
per). 85¢. 

Freeman, Frank S. Theory and practice of psycho- 
logical testing. (Rev. Ed.) New York: Holt, 1955. 
Pp. xvi + 609. $5.25. 


New Books and Tests 


Ghiselli, Edwin E., & Brown, Clarence W. Personnel 
and industrial psychology. (2nd Ed.) New York: 
McGraw-Hill, 1955. Pp. ix + 492. $5.00. 

Gillespie, James M., & Allport, Gordon W. Youth’s 
outlook on the future. Doubleday Papers in Psy- 
chology, No. 15. Garden City, N. Y.: Doubleday, 
1955. Pp. ix +61 (paper). 85¢. 

Glover, Edward. The technique of psycho-analysis. 
New York: International Universities Press, 1955. 
Pp. x + 404. $7.50. 

Greer, Scott A. Social organization. Doubleday Short 
Studies in Sociology, No. 9. Garden City, N. Y.: 
Doubleday, 1955. Pp. x + 68 (paper). 95¢. 

Jewish Vocational Service. Words for work. Boston: 
Jewish Vocational Service, 1955. Pp. 140 (paper). 
$1.00. 

Karn, Harry W., & Weitz, Joseph. An introduction 
to psychology. New York: Wiley, 1955. Pp. xii+ 
315. $3.90. 

McCary, James L. (Ed.) Six approaches to psycho- 
therapy. New York: Dryden Press, 1955. Pp. vii 
+ 402. $3.75. 

Maier, Norman R. F. Psychology in industry. (2nd 
Ed.) Boston: Houghton Mifflin, 1955. Pp. xiv + 
678. $5.50. 

Mayer, Jurt B. Class and society. Doubleday Short 
Studies in Sociology, No. 10. Garden City, N. Y.: 
Doubleday, 1955. Pp. vii + 88 (paper). 95¢. 

Michaels, Joseph J. Disorders of character. Spring- 
field, Ill.: Charles C Thomas, 1955. Pp. x + 148. 

Munn, Norman L. The evolution and growth of hu- 
man behavior. Boston: Houghton Mifflin, 1955. 
Pp. xi + 525. $6.50. 

National Conference of Social Work. Casework pa- 
pers, 1954. New York: Family Service Association 
of America, 1955. Pp. 150 (paper). 

Oates, Wayne E. Religious factors in mental illness. 
New York: Association Press, 1955. Pp. xx + 239. 
$3.50. 

Podolsky, Edward. (Ed.) Management of addictions. 
New York: Philosophical Library, 1955. Pp. xvii 
+ 413. $7.50. 

Ralli, Elaine P. (Ed.) Adrenal cortex. Transactions 
of the Fifth Conference, 1953. New York: Josiah 
Macy, Jr. Foundation, 1954. Pp. 187. $3.75. 

Reitman, Francis. Insanity, art, and culture. New 
York: Philosophical Library, 1954. Pp. 111. $3.75. 

Rothstein, Jerome H., & O’Connor, Thomas. Films 
on the handicapped. Washington: International 
Council for Exceptional Children, 1955. Pp. vi+ 
56 (paper). $1.00. 

Thorpe, Louis P. Child psychology and develop- 
ment. New York: Ronald, 1955. Pp. v + 709. $6.00. 

U. S. Department of Health, Education, and Wel- 
fare. Public Health Service. Evaluation in mental 
health. Washington: U. S. Government Printing 
Office, 1955. Pp. x + 292. $2.00. 

Wallin, J. E. Wallace. Education of mentally handi- 
capped children. New York: Harper, 1955. Pp. 
xiii + 485. $4.50. 

Wallin, J. E. Wallace. The odyssey of a psycholo- 
gist. Wilmington 4, Del. (311 Highland Ave., Lyn- 
dalia): Author, 1955. Pp. xvii + 243 (paper) . $3.00. 




















Again Available 


SYMPOSIUM: PSYCHOANALYSIS AS SEEN BY 
ANALYZED PSYCHOLOGISTS 


This well-known symposium, which first appeared in the Journal 
of Abnormal and Social Psychology in 1940, has now been reprinted. 
The contributors are Edwin G. Boring, Carney Landis, J. F. Brown, 
Raymond R. Willoughby, Percival M. Symonds, Henry A. Murray, 
Else Frenkel-Brunswik, David Shakow, Donald V. McGranahan, and 
Austin B. Wood. Comments on the symposium are made by Hanns 
Sachs and Franz Alexander. 160 pages. 

Price, $2.00 


Order from 


American Psychological Association 
1333 Sixteenth Street N. W. 
Washington 6, D. 
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